Terminal device, information processing device, object identifying method, program, and object identifying system

• US 9,256,796 B2
• Filed: 03/19/2012
• Issued: 02/09/2016
• Est. Priority Date: 03/25/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yoshigahara, Takayuki, Fukuchi, Masaki
• Primary Examiner(s): Harandi, Siamak
• Application Number:
  US13/424,114
• Publication Number:
  US 20120242842A1
• Time in Patent Office: 1,422 Days
• Field of Search: 382/190
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2115 by evaluating different subsets according to an optimisation criterion, e.g. class separability, forward selection or backward elimination
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

A device, apparatus, and method provide logic for processing information. In one implementation, a device may include an image acquisition unit configured to acquire an image, and a transmission unit configured to transmit information associated with the image to an information processing apparatus, such as a server. The server may be associated with a first feature quantity dictionary. The device also may include a receiving unit configured to receive a second feature quantity dictionary from the server in response to the transmission. The second feature quantity dictionary may include less information than the first feature quantity dictionary, and the server may generate the second feature quantity dictionary based on the image information and the first feature quantity dictionary. The device may include an identification unit configured to identify an object within the image using the second feature quantity dictionary.

Claims

1. A device, comprising:

an image acquisition unit configured to acquire a first image;

a transmission unit configured to transmit first information associated with the first image and an assistance information to a server, the server being associated with a first feature quantity dictionary;

a receiving unit configured to receive a second feature quantity dictionary from the server in response to the transmission, the second feature quantity dictionary comprising less information than the first feature quantity dictionary; and

an identification unit configured to identify an object within the first image using the second feature quantity dictionary,

wherein the second feature quantity dictionary is a filtered version of the first feature quantity dictionary that is stored on the server, and the second feature quantity dictionary represents a subset of the first feature quantity dictionary and contains only selected contents of the first feature quantity dictionary having a highest relation to the first information and satisfying a threshold criteria,

wherein an amount of contents that is selected from the first feature quantity dictionary as the subset forming the second feature quantity dictionary is based on a capability or processing ability of the device, and the amount of contents selected is determined and set based on a capability information contained in the assistance information transmitted from the transmission unit to the server, and

wherein the image acquisition unit, the transmission unit, the receiving unit, and the identification unit are each implemented via at least one processor.

2. The device of claim 1, wherein the information of the second feature quantity dictionary comprises feature quantities of a plurality of objects.

3. The device of claim 1, wherein the objects of the second feature quantity dictionary comprise at least one of (i) an object predicted to fall within the first image or (ii) an object predicted to fall within one or more second images acquired by the image acquisition unit subsequent to the first image.

4. The device of claim 2, wherein the identification unit is further configured to:

extract at least one feature quantity from the first image; and

determine whether the extracted feature quantity corresponds to at least one of the feature quantities of the second feature quantity dictionary; and

identify the object within the first image, based on at least the determination.

5. The device of claim 4, wherein the identification unit is further configured to:

obtain, based on the second feature quantity dictionary information, an object identifier associated with the corresponding feature quantity; and

identify the object within the first image, based on the obtained object identifier.

6. The device of claim 1, wherein the first information comprises at least one of a portion of the first image or a feature quantity associated with the portion of the first image.

7. The device of claim 1, wherein the transmitting unit is further configured to transmit, to the server, second information associated with the first image, the second information comprising at least one geographic position associated with the first image.

10. The device of claim 1, wherein the capability information indicates at least one of a number of pieces of data processable by the device, a number of processor cores of the device, and a memory capacity of the device.

8. A computer-implemented method, comprising:

acquiring a first image;

transmitting information associated with the first image and an assistance information to a server, the server being associated with a first feature quantity dictionary;

receiving a second feature quantity dictionary from the server in response to the transmission, the second feature quantity dictionary comprising less information than the first feature quantity dictionary; and

identifying, using a processor, an object within the first image using the second feature quantity dictionary,

wherein the second feature quantity dictionary is a filtered version of the first feature quantity dictionary that is stored on the server, and the second feature quantity dictionary represents a subset of the first feature quantity dictionary and contains only selected contents of the first feature quantity dictionary having a highest relation to the first information and satisfying a threshold criteria, and

wherein an amount of contents selected that is from the first feature quantity dictionary as the subset forming the second feature quantity dictionary is based on a capability or processing ability of a device implementing the method, and the amount of contents selected is determined and set based on a capability information contained in the assistance information transmitted to the server.

11. The computer-implemented method of claim 8, wherein the capability information indicates at least one of a number of pieces of data processable by the device, a number of processor cores of the device, and a memory capacity of the device.

9. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to perform a method, the method comprising:

acquiring a first image;

transmitting information associated with the first image and an assistance information to a server, the server being associated with a first feature quantity dictionary;

receiving a second feature quantity dictionary from the server in response to the transmission, the second feature quantity dictionary comprising less information than the first feature quantity dictionary; and

identifying, using a processor, an object within the first image using the second feature quantity dictionary,

wherein the second feature quantity dictionary is a filtered version of the first feature quantity dictionary that is stored on the server, and the second feature quantity dictionary represents a subset of the first feature quantity dictionary and contains only selected contents of the first feature quantity dictionary having a highest relation to the first information and satisfying a threshold criteria, and

wherein an amount of contents that is selected from the first feature quantity dictionary as the subset forming the second feature quantity dictionary is based on a capability or processing ability of a device implementing the method, and the amount of contents selected is determined and set based on a capability information contained in the assistance information transmitted to the server.

12. The non-transitory computer-readable medium of claim 9, wherein the capability information indicates at least one of a number of pieces of data processable by the device, a number of processor cores of the device, and a memory capacity of the device.