Storing information for access using a captured image

• US 10,445,618 B2
• Filed: 06/27/2017
• Issued: 10/15/2019
• Est. Priority Date: 02/11/2005
• Status: Active Grant

• Current Assignee: Mobile Acuity Limited
• Original Assignee: Mobile Acuity Limited
• Inventors: Ashbrook, Anthony Peter, Wright, Mark William
• Primary Examiner(s): Seth, Manav
• Application Number:
  US15/634,283
• Publication Number:
  US 20170293822A1
• Time in Patent Office: 840 Days
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/2187 with image input from a plurality of different locations or from a non-central location, e.g. from one or more users
• CPC Class Codes: H04N 1/2191 for simultaneous, independent access by a plurality of different users
• CPC Class Codes: H04N 1/32101 Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3225 of data relating to an image, a page or a document
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 2201/3254 Orientation, e.g. landscape or portrait; Location or order of the image data, e.g. in memory
• CPC Class Codes: H04N 5/76 Television signal recording

Abstract

An electronic device associates first information and at least a first portion of a first image, and uses a second image that includes a portion corresponding to at least the first portion of the first image to access the associated first information.

Claims

1. An electronic user device comprising:

a processor; and

a memory including computer program code, wherein the memory, computer program code and processor are configured;

to enable definition, by a user of the electronic user device, of user-defined information for access by multiple users via association at a server with at least a first portion of a first image, wherein the user-defined information augments first user-defined information already associated at the server with at least the first portion of a first image for access by multiple users; and

to enable using a captured second image that includes a portion corresponding to at least the first portion of the first image to access, at the server via a network, the user-defined information previously defined by the user of the electronic user device and associated at the server with at least a first portion of a first image and the first user-defined information associated at the server with at least the first portion of the first image, and to receive in reply the accessed user-defined information previously defined by the user of the electronic device and the first user-defined information.

2. An electronic user device as claimed in claim 1, wherein the second image includes a portion corresponding to at least the first portion of the first image if interest points extracted from the portion of the second image match interest points extracted from the first image.

3. An electronic user device as claimed in claim 1, wherein the memory, computer program code and processor are configured:

to output the accessed information.

4. An electronic user device as claimed in claim 1, wherein the memory, computer program code and processor are configured:

to enable user selection of an area, at least a portion of which is the first portion, in the first image with which the user-defined information is associated.

5. An electronic user device as claimed in claim 1, wherein the memory, computer program code and processor are configured:

to enable composition by the user of the user-defined information.

6. An electronic user device as claimed in claim 1, wherein the captured second image is sent with an application identifier that causes a subset of a database to be searched by the server.

7. An electronic user device as claimed in claim 1, wherein the user-defined information is text.

8. An electronic user device as claimed in claim 1, comprising a radio transceiver for communication with a cellular telecommunications network, wherein the computer program code is provided via the cellular telecommunications network.

9. A method of storing user-defined information for future access by multiple parties comprising, at a server controlled by a third party:

receiving from a first originating party user-defined information that is defined by the first originating party and is for access by multiple parties; and

associating the user-defined information received from the first originating party and at least a first portion of a first image in a database, wherein the user-defined information augments first user-defined information already associated at the server with at least the first portion of a first image in the database; and

providing access by a second party to the user-defined information and the first user-defined information, when a second image, captured by the second party, includes a portion corresponding to at least the first portion of the first image.

10. A method as claimed in claim 9, further comprising:

providing access by a further party, using a captured third image that includes a portion corresponding to at least the first portion of the first image, to the user-defined information.

11. A method as claimed in claim 9, further comprising:

extracting interest points from the portion of the second image;

extracting interest points from the first image;

providing access by a second party to the user-defined information, when the interest points extracted from the portion of the second image matches the interest points extracted from the first image.

12. A method as claimed in claim 9, wherein the first image is received from the first originating party and/or wherein the first image is received via a network (4) in a message.

13. A method as claimed in claim 9, wherein the user-defined information is text.

14. A method as claimed in claim 9, further comprising:

processing a target region of the first image defined by the first originating party to create a model user image key; and

linking the created model user image key with the user-defined information in the database.

15. A method as claimed in claim 14, further comprising:

creating a scene user image key for the captured second image;

searching the database for correspondence between the created scene user image key and a model user image key stored in the database; and

if there is correspondence, obtaining the user-defined information linked to the corresponding model user image key.

20. A non-transitory computer-readable storage medium encoded with instructions that, when performed by a processor of an electronic device, cause performance of the method of claim 9.

16. A server for control by a third party comprising:

a processor; and

wherein the memory, computer program code and processor are configured;

to receive user-defined information from a first user different to the third party for access by multiple parties; and

to associate the received user-defined information and at least a first portion of a first image in a database, wherein the user-defined information augments first user-defined information already associated at the server with at least the first portion of the first image in the database; and

to provide access by a remote second user to the user-defined information and the first user-defined information when a second image, captured by the remote second user, includes a portion corresponding to at least the first portion of the first image.

17. A server as claimed in claim 16, wherein the server comprises the database.

18. A server as claimed in claim 16, wherein the database has a plurality of entries each of which associates one of a plurality of image portions with respective information.

19. A server as claimed in claim 16, wherein the user-defined information is received via a network.

21. An electronic user device comprising:

means for definition, by a user of the electronic user device, of user-defined information for access by multiple users via association at a server with at least a first portion of a first image, wherein the user-defined information augments first user-defined information already associated at the server with at least the first portion of a first image for access by multiple users; and

a camera for capturing a second image that includes a portion corresponding to at least the first portion of the first image; and

means for using the captured second image to access, at the server via a network, the user-defined information previously defined by the user of the electronic user device and associated at the server with at least a first portion of a first image and the first user-defined information associated at the server with at least the first portion of the first image, and for receiving in reply the accessed user-defined information previously defined by the user of the electronic device and the first user-defined information.

22. An electronic user device as claimed in claim 21, comprising user input means for enabling user selection of an area, at least a portion of which is the first portion, in the first image with which the user-defined information is associated.

23. An electronic user device as claimed in claim 21, comprising means for composing the user-defined information.