Terminal device, information processing device, object identifying method, program, and object identifying system

• US 10,311,333 B2
• Filed: 03/20/2018
• Issued: 06/04/2019
• Est. Priority Date: 03/25/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yoshigahara, Takayuki, Fukuchi, Masaki
• Primary Examiner(s): Harandi, Siamak
• Application Number:
  US15/926,367
• Publication Number:
  US 20180211136A1
• Time in Patent Office: 441 Days
• CPC Class Codes: G06F 18/2115 by evaluating different subsets according to an optimisation criterion, e.g. class separability, forward selection or backward elimination
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/10 Image acquisition document image scanning and transmission H04N1/00; control of digital cameras H04N23/60
• CPC Class Codes: G06V 10/17 using hand-held instruments
• CPC Class Codes: G06V 10/40 Extraction of image or video features
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

A device, apparatus, and method provide logic for processing information. In one implementation, a device may include an image acquisition unit configured to acquire an image, and a transmission unit configured to transmit information associated with the image to an information processing apparatus, such as a server. The server may be associated with a first feature quantity dictionary. The device also may include a receiving unit configured to receive a second feature quantity dictionary from the server in response to the transmission. The second feature quantity dictionary may include less information than the first feature quantity dictionary, and the server may generate the second feature quantity dictionary based on the image information and the first feature quantity dictionary. The device may include an identification unit configured to identify an object within the image using the second feature quantity dictionary.

Claims

1. An image processing method, the method being executed via at least one processor, and comprising:

acquiring a first image including a first real object;

transmitting, to a server, a first information associated with the first image;

acquiring, from the server and based on the first information associated with the first image, a data set that includes a second augmented reality (AR) content associated with a second real object;

recognizing the second real object based on the data set; and

controlling a display to display, based on the data set, the second augmented reality (AR) content related to the second real object,

wherein the second real object is different from the first real object,

wherein the second real object is not included in the first image, and

wherein the second real object is predicted to appear in one or more subsequent acquired images.

2. The image processing method according to claim 1, wherein the data set includes a first augmented reality (AR) associated with the first real object.

3. The image processing method according to claim 1, wherein the data set includes feature data associated with the second real object.

4. The image processing method according to claim 1, further comprising:

transmitting, to the server, the first information in response to a detected trigger event.

5. The image processing method according to claim 4, wherein the detected trigger event is a user instruction.

6. The image processing method according to claim 1, wherein the first information includes a position information of an apparatus which executes the image processing method.

7. The image processing method according to claim 1, wherein the first information includes a time information.

8. The image processing method according to claim 1, wherein the first information includes capability information of an apparatus which executes the image processing method.

9. The image processing method according to claim 8, wherein the capability information of the apparatus indicates at least one of a number of pieces of data processable by the apparatus, a number of processor cores of the apparatus, and a memory capacity of the apparatus.

10. The image processing method according to claim 1, wherein the data set comprises only selected feature data having highest relations to the first information associated with the first image and satisfying a threshold criteria.

11. The image processing method according to claim 10, wherein the feature data of the data set comprises (i) a real object predicted to fall within the first image or (ii) a real object predicted to fall within one or more second images acquired subsequent to the first image.

12. The image processing method according to claim 10, further comprising:

extracting at least one feature quantity from the first image;

determining whether the extracted feature quantity corresponds to at least one of the feature data of the data set; and

identifying the second real object within the first image, based on at least the determination.

13. The image processing method according to claim 12, further comprising:

obtaining, based on the data set, an object identifier associated with the corresponding feature data; and

identifying the second real object within the first image, based on the obtained object identifier.

14. A device, comprising:

circuitry configured to;

acquire a first image including a first real object;

transmit, to a server, a first information associated with the first image;

acquire, from the server and based on the first information associated with the first image, a data set that includes a second augmented reality (AR) content associated with a second real object;

recognize the second real object based on the data set; and

control a display to display, based on the data set, the second augmented reality (AR) content related to the second real object,

wherein the second real object is different from the first real object,

wherein the second real object is not included in the first image, and

wherein the second real object is predicted to appear in one or more subsequent acquired images.

15. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

acquiring a first image including a first real object;

transmitting, to a server, a first information associated with the first image;

acquiring, from the server and based on the first information associated with the first image, a data set that includes a second augmented reality (AR) content associated with a second real object;

recognizing the second real object based on the data set; and

controlling a display to display, based on the data set, the second augmented reality (AR) content related to the second real object,

wherein the second real object is different from the first real object,

wherein the second real object is not included in the first image, and

wherein the second real object is predicted to appear in one or more subsequent acquired images.