SYSTEMS AND METHODS FOR IMAGE RECOGNITION USING MOBILE DEVICES
First Claim
1. A mobile device, comprising:
- a wireless interface to a server; and
a processor, communicating with the wireless interface, the processor being configured to initiate processing comprising;
acquiring an image;
detecting one or more objects in the acquired image;
generating metadata associated with at least one of the detected objects;
extracting a query image from the acquired image based on the at least one object;
generating a visual search query, wherein the visual search query includes the query image and the metadata;
communicating the visual search query to the server via the wireless interface; and
receiving and presenting, in response to the visual search query, information content associated with the at least one object.
2 Assignments
0 Petitions
Accused Products
Abstract
Implementations relate to systems and methods for real-time image recognition and mobile visual searching. A mobile device, such as a cellular phone, acquires an image and pre-processes the acquired image to generate a visual search query based on objects detected in the acquired image. The visual search query includes the acquired image or a query image extracted therefrom and metadata associated with the detected objects. The mobile device wirelessly communicates the visual search query to a remote server, and in response to the visual search query, the remote server recognizes an object in the query image based on the associated metadata. The remote server then generates information content based on the recognized object and communicates the information content to the mobile device to be presented via the mobile device.
-
Citations
57 Claims
-
1. A mobile device, comprising:
-
a wireless interface to a server; and a processor, communicating with the wireless interface, the processor being configured to initiate processing comprising; acquiring an image; detecting one or more objects in the acquired image; generating metadata associated with at least one of the detected objects; extracting a query image from the acquired image based on the at least one object; generating a visual search query, wherein the visual search query includes the query image and the metadata; communicating the visual search query to the server via the wireless interface; and receiving and presenting, in response to the visual search query, information content associated with the at least one object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method of performing image recognition, comprising:
-
acquiring an image by a mobile device; detecting one or more objects in the acquired image; generating metadata associated with at least one of the detected objects; extracting a query image from the acquired image based on the at least one object; generating a visual search query, wherein the visual search query includes the query image and the metadata; wirelessly communicating the visual search query; and receiving and presenting, in response to the visual search query, information content associated with the at least one object. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21)
-
-
22. A system for performing image recognition, comprising:
-
means for acquiring an image by a mobile device; means for detecting one or more objects in the acquired image; means for generating metadata associated with at least one of the detected objects; means for extracting a query image from the acquired image based on the at least one object; means for generating a visual search query, wherein the visual search query includes the query image and the metadata; means for wirelessly communicating the visual search query; and means for receiving and presenting, in response to the visual search query, information content associated with the at least one object. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29)
-
-
30. A computer program product, comprising:
computer-readable medium storing instructions that cause a computer to perform image recognition when executed by the computer, comprising; at least one instruction for causing the computer to acquire an image; at least one instruction for causing the computer to detect one or more objects in the acquired image; at least one instruction for causing the computer to generate metadata associated with at least one of the detected objects; at least one instruction for causing the computer to extract a query image from the acquired image based on the at least one object; at least one instruction for causing the computer to generate a visual search query, wherein the visual search query includes the query image and the metadata; at least one instruction for causing the computer to wirelessly communicate the visual search query; and at least one instruction for causing the computer to receive and present, in response to the visual search query, information content associated with the at least one object. - View Dependent Claims (31, 32, 33, 34, 35, 36, 37)
-
38. A system for performing image recognition, comprising:
a server configured to; receive a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image, recognize an object in the image associated with the at least one object based on the metadata, generate information content based on the recognized object, and communicate the information content in response to the visual search query. - View Dependent Claims (39, 40, 41, 42, 43, 44, 45)
-
46. A method of performing image recognition, comprising:
-
receiving a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image; recognizing an object in the image associated with the at least one object based on the metadata; generating information content based on the recognized object; and communicating the information content in response to the visual search query. - View Dependent Claims (47, 48, 49)
-
-
50. A system of performing image recognition, comprising:
-
means for receiving a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image; means for recognizing an object in the image associated with the at least one object based on the metadata; means for generating information content based on the recognized object; and means for communicating the information content in response to the visual search query. - View Dependent Claims (51, 52, 53)
-
-
54. A computer program product, comprising:
computer-readable medium storing instructions that cause a computer to perform image recognition when executed by the computer, comprising; at least one instruction for causing the computer to receive a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image; at least one instruction for causing the computer to recognize an object in the image associated with the at least one object based on the metadata; at least one instruction for causing the computer to generate information content based on the recognized object; and at least one instruction for causing the computer to communicate the information content in response to the visual search query. - View Dependent Claims (55, 56, 57)
Specification