Terminal device, information processing device, object identifying method, program, and object identifying system

• US 9,971,957 B2
• Filed: 11/25/2015
• Issued: 05/15/2018
• Est. Priority Date: 03/25/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yoshigahara, Takayuki, Fukuchi, Masaki
• Primary Examiner(s): Harandi, Siamak
• Application Number:
  US14/951,801
• Publication Number:
  US 20160078318A1
• Time in Patent Office: 902 Days
• CPC Class Codes: G06F 18/2115 by evaluating different subsets according to an optimisation criterion, e.g. class separability, forward selection or backward elimination
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

A device, apparatus, and method provide logic for processing information. In one implementation, a device may include an image acquisition unit configured to acquire an image, and a transmission unit configured to transmit information associated with the image to an information processing apparatus, such as a server. The server may be associated with a first feature quantity dictionary. The device also may include a receiving unit configured to receive a second feature quantity dictionary from the server in response to the transmission. The second feature quantity dictionary may include less information than the first feature quantity dictionary, and the server may generate the second feature quantity dictionary based on the image information and the first feature quantity dictionary. The device may include an identification unit configured to identify an object within the image using the second feature quantity dictionary.

Claims

1. A device, comprising:

circuitry configured to;

acquire a first image including a first real object;

transmit, to a server, a first information associated with the first image;

acquire, from the server, a dictionary that includes at least a feature data for identifying a second real object that is not included in the first image, based on the first information associated with the first image; and

control a display to display an augmented reality (AR) content related to the first real object,

wherein the second real object is different from the first real object, and the second real object is predicted to appear in one or more subsequent acquired images.

2. The device of claim 1, wherein the dictionary comprises only selected feature data having highest relations to the first information associated with the first image and satisfying a threshold criteria.

3. The device of claim 1, wherein the feature data of the dictionary comprises at least one of (i) feature data of the second real object predicted to fall within the first image or (ii) feature data of the second real object predicted to fall within the one or more subsequent acquired images that are acquired subsequent to the first image.

4. The device of claim 1, wherein the circuitry is further configured to:

extract at least one feature quantity from the first image;

determine whether the extracted feature quantity corresponds to at least one of the feature data of the dictionary; and

identify the first real object within the first image, based on at least the determination.

5. The device of claim 4, wherein the circuitry is further configured to:

obtain, based on the dictionary, an object identifier associated with the corresponding feature data; and

identify the first real object within the first image, based on the obtained object identifier.

6. The device of claim 1, wherein the first information associated with the first image comprises at least one of a portion of the first image or a feature data associated with a portion of the first image.

7. The device of claim 1, wherein the first information associated with the first image comprises at least one geographic position associated with the first image.

8. The device of claim 1, wherein the circuitry is further configured to transmit a capability information of the device that indicates at least one of a number of pieces of data processable by the device, a number of processor cores of the device, and a memory capacity of the device.

11. The device according to claim 1, wherein the second real object is different than the AR content related to the first real object.

9. A computer-implemented method, comprising:

acquiring a first image including a first real object;

transmitting, to a server, a first information associated with the first image;

acquiring, from the server, a dictionary that includes at least a feature data for identifying a second real object that is not included in the first image, based on the first information associated with the first image; and

controlling a display to display an augmented reality (AR) content related to the first real object,

wherein the second real object is different from the first real object, and the second real object is predicted to appear in one or more subsequent acquired images.

10. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

acquiring a first image including a first real object;

transmitting, to a server, a first information associated with the first image;

acquiring, from the server, a dictionary that includes at least a feature data for identifying a second real object that is not included in the first image, based on the first information associated with the first image; and

controlling a display to display an augmented reality (AR) content related to the first real object,

wherein the second real object is different from the first real object, and the second real object is predicted to appear in one or more subsequent acquired images.