Information processing terminal, information processing method, and program

• US 9,269,004 B2
• Filed: 12/05/2012
• Issued: 02/23/2016
• Est. Priority Date: 12/26/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Nakamura, Takatoshi, Shionozaki, Atsushi, Mitsuya, Koshiro
• Primary Examiner(s): Xiao, Ke
• Assistant Examiner(s): LIU, GORDON G
• Application Number:
  US13/705,456
• Publication Number:
  US 20130162674A1
• Time in Patent Office: 1,175 Days
• Field of Search: 345/649, 345/619, 345/659, 345/650, 345/158, 345/672, 345/168, 345/474, 345/630, 345/647, 345/653, 345/661, 345/473, 345/173
• US Class Current: 1/1
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

An information processing terminal includes a recognition unit that recognizes an identifier projected over an image, an acquisition unit that acquires data of an object corresponding to the identifier, a processing unit that changes the orientation of the object according to the positional relationship between the information processing terminal itself and the identifier specified based on the image and, when it is no longer able to recognize the identifier, changes the orientation of the object according to the positional relationship between the information processing terminal itself and the identifier specified based on sensor data, and a display control unit that causes the object of which the orientation is changed according to the positional relationship between the information processing terminal itself and the identifier to be displayed over the image in a superimposed manner.

Claims

1. An information processing terminal comprising:

recognition circuitry that recognize an identifier projected over an image;

acquisition circuitry that acquire data of an object corresponding to the identifier;

processing circuitry that change the orientation of the object according to a positional relationship between the information processing terminal itself and the identifier specified based on the image while a position of the information processing terminal is closing into a horizontal plane on which the identifier is placed, and when it is no longer able to recognize the identifier as an angle between the information processing terminal and the horizontal plane reaches a minimum angle beyond which the identifier is not recognizable, changes the orientation of the object according to the positional relationship between the information processing terminal itself and the identifier specified based on sensor data generated from sensor circuitry measuring angular velocity occurring around each axis of X, Y, and Z axes used to define position of the object, wherein the information processing terminal determines a period, during which the angular velocity equals to or higher than a threshold is measured, as the period for performing correction of the positional relationship between the information processing terminal and the identifier by the sensor circuitry; and

display control circuitry that cause the object of which the orientation is changed according to the positional relationship between the information processing terminal itself and the identifier to be displayed over the image in a superimposed manner.

2. The information processing terminal according to claim 1, further comprising:

capturing circuitry,

wherein the recognition circuitry recognize the identifier projected over the image captured by the capturing circuitry.

3. The information processing terminal according to claim 1, wherein the processing circuitry change the orientation of the object according to the positional relationship between the information processing terminal itself and the identifier specified based on the sensor data detected at the time when and after the identifier can be last recognized when it is no longer able to recognize the identifier.

4. The information processing terminal according to claim 1, wherein the sensor circuitry include a gyro sensor.

5. The information processing terminal according to claim 1, wherein the identifier is a two-dimensional code including regions with different colors.

6. An information processing method comprising:

recognizing an identifier projected over an image;

acquiring data of an object corresponding to the identifier;

changing the orientation of the object according to a positional relationship between the information processing terminal itself and the identifier specified based on the image while a position of the information processing terminal is closing into a horizontal plane on which the identifier is placed, and when it is no longer able to recognize the identifier as an angle between the information processing terminal and the horizontal plane reaches a minimum angle beyond which the identifier is not recognizable, changing the orientation of the object according to the positional relationship between the information processing terminal itself and the identifier specified based on sensor data generated from sensor circuitry measuring angular velocity occurring around each axis of X, Y, and Z axes used to define position of the object, wherein the information processing terminal determines a period, during which the angular velocity equals to or higher than a threshold is measured, as the period for performing correction of the positional relationship between the information processing terminal and the identifier by the sensor circuitry; and

causing the object of which the orientation is changed according to the positional relationship between the information processing terminal itself and the identifier to be displayed over the image in a superimposed manner.

7. A non-transitory computer readable medium storing a program thereon that, when executed by a computer, causes the computer to perform a process comprising:

recognizing an identifier projected over an image;

acquiring data of an object corresponding to the identifier;

changing the orientation of the object according to a positional relationship between the information processing terminal itself and the identifier specified based on the image while a position of the information processing terminal is closing into a horizontal plane on which the identifier is placed, and when it is no longer able to recognize the identifier as an angle between the information processing terminal and the horizontal plane reaches a minimum angle beyond which the identifier is not recognizable, changing the orientation of the object according to the positional relationship between the information processing terminal itself and the identifier specified based on sensor data generated from sensor circuitry measuring angular velocity occurring around each axis of X, Y, and Z axes used to define position of the object, wherein the information processing terminal determines a period, during which the angular velocity equals to or higher than a threshold is measured, as the period for performing correction of the positional relationship between the information processing terminal and the identifier by the sensor circuitry; and

causing the object of which the orientation is changed according to the positional relationship between the information processing terminal itself and the identifier to be displayed over the image in a superimposed manner.