SYSTEM, APPARATUS AND METHOD FOR PROVIDING CONTENT BASED ON VISUAL SEARCH
First Claim
1. An application supplying apparatus comprising a network interface unit for communicating through a network, a processing unit and a storage unit storing an application service program embodying a program of instructions executable by the processing unit to supply a content access application through the network interface unit via the network to a user terminal having a network communication unit, for user access to additional content, wherein said application supplied by said application supplying apparatus via the network to the user terminal comprises:
- a user interface part that provides a user interface on the user terminal, to permit the user to invoke an image capture function on the user terminal to capture an image including one or more image objects, and add, as geo data associated with the captured image, location data indicating a current position of the user terminal as determined by a location determining function on the user terminal; and
a content obtaining part that, for each particular image object amongst said one or more image objects, (i) causes the particular image object to be extracted from the captured image and causes a visual search for the particular image object to be conducted in an image association database, to determine one or more associated items in the image association database that include image information matching the particular image object and that further include location information encompassing the geo data associated with the captured image, (ii) presents, for each particular item of the one or more associated items, content information which is registered in connection with the particular item in the image association database, through the user interface for user selection, and (iii) upon receiving the user selection through the user interface of said content information registered in connection with the particular item in the image association database, presenting, through the user interface, additional content corresponding to the content information.
1 Assignment
0 Petitions
Accused Products
Abstract
Information technology tools can be provided to provide user access to content based on an image captured on a user device. One or more image objects are extracted from the captured image and are utilized, for example, along with the location of the user device, to perform a visual search in an image association database to retrieve and display content information corresponding to a matched image object.
-
Citations
20 Claims
-
1. An application supplying apparatus comprising a network interface unit for communicating through a network, a processing unit and a storage unit storing an application service program embodying a program of instructions executable by the processing unit to supply a content access application through the network interface unit via the network to a user terminal having a network communication unit, for user access to additional content, wherein said application supplied by said application supplying apparatus via the network to the user terminal comprises:
-
a user interface part that provides a user interface on the user terminal, to permit the user to invoke an image capture function on the user terminal to capture an image including one or more image objects, and add, as geo data associated with the captured image, location data indicating a current position of the user terminal as determined by a location determining function on the user terminal; and a content obtaining part that, for each particular image object amongst said one or more image objects, (i) causes the particular image object to be extracted from the captured image and causes a visual search for the particular image object to be conducted in an image association database, to determine one or more associated items in the image association database that include image information matching the particular image object and that further include location information encompassing the geo data associated with the captured image, (ii) presents, for each particular item of the one or more associated items, content information which is registered in connection with the particular item in the image association database, through the user interface for user selection, and (iii) upon receiving the user selection through the user interface of said content information registered in connection with the particular item in the image association database, presenting, through the user interface, additional content corresponding to the content information. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A mobile application including a program of instructions tangibly embodied in a non-transitory computer-readable medium and when executed by a computer comprises:
-
a user interface part that provides a user interface on the computer, to permit a user to invoke an image capture function to capture an image including one or more image objects, and add, as geo data associated with the captured image, location data indicating a current position of the computer as determined by a location determining function; and a content obtaining part that, for each particular image object amongst said one or more image objects, (i) causes the particular image object to be extracted from the captured image and causes a visual search for the particular image object to be conducted in an image association database, to determine one or more associated items in the image association database that include image information matching the particular image object and that further include location information encompassing the geo data associated with the captured image, (ii) presents, for each particular item of the one or more associated items, content information which is registered in connection with the particular item in the image association database, through the user interface for user selection, and (iii) upon receiving the user selection through the user interface of said content information registered in connection with the particular item in the image association database, presenting, through the user interface, additional content corresponding to the content information. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A method for providing user access to additional content based on a captured image, the method comprising:
-
(a) providing a content access application through a network to a user terminal to provide a user interface on the user terminal, to permit a user at the user terminal to invoke an image capture function on the user terminal to capture an image including one or more image objects, and add, as geo data associated with the captured image, location data indicating a current position of the user terminal as determined by a location determining function on the user terminal; (b) causing, for each particular image object amongst said one or more image objects, (i) the particular image object to be extracted from the captured image and (ii) a visual search for the particular image object to be conducted in an image association database, to determine one or more associated items in the image association database that include image information matching the particular image object and that further include location information encompassing the geo data associated with the captured image; (c) transmitting, for each particular item of the one or more associated items, content information which is registered in connection with the particular item in the image association database, to the user terminal to be displayed to the user, by the content access application, through the user interface for user selection; (d) receiving, through the user interface, the user selection of said content information registered in connection with the particular item in the image association database; (e) requesting additional content corresponding to the user-selected content information from an external content source; (f) receiving the additional content corresponding to the user-selected content information from the external content source; and (f) transmitting the received additional content to the user terminal to be presented to the user. - View Dependent Claims (17, 18, 19, 20)
-
Specification