Information processing to display information based on position of the real object in the image

• US 10,074,216 B2
• Filed: 08/13/2014
• Issued: 09/11/2018
• Est. Priority Date: 11/13/2013
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Kasahara, Shunichi
• Primary Examiner(s): Amini, Javid A
• Application Number:
  US15/025,500
• Publication Number:
  US 20160210788A1
• Time in Patent Office: 1,490 Days
• Field of Search: 345633
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/242 by image rotation, e.g. by 90 degrees
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

A display control device includes a record reference unit configured to refer to a record in which an image, an object included in the image, and a position where the object is displayed or an orientation of the object in the image are associated with one another; and a display controller configured to perform a transition from display of a first image including the object to display of a second image including the object based on the record while maintaining the position where the object is displayed or the orientation of the object, the second image being different from the first image.

Claims

1. A display control device, comprising:

a Central Processing Unit (CPU) and a memory configured to store instructions for execution by the CPU, the CPU configured to;

refer to a record that corresponds to a first plurality of objects,

wherein the record includes an association of an image id of a first image, an object id of a first object of the first plurality of objects included in the first image, a first position of the first object in the first image, and a first orientation of the first object in the first image;

control a display screen to display a second image including the first plurality of objects; and

control the display screen to subsequently display a third image including the first object and a second plurality of objects of the first plurality of objects based on the referred record such that, at least one of a second position of the first object and a third position of the first object in the third image are same or a second orientation of the first object in the second image and a third orientation of the first object in the third image are same,

wherein number of the second plurality of objects are less than number of the first plurality of objects, and

wherein the second image is different from the first image.

2. The display control device according to claim 1, wherein the CPU is further configured to:

change the second orientation of the first object in the second image to a fourth orientation, and

control the display screen to temporarily maintain first object in the fourth orientation after transition to the display of the third image.

3. The display control device according to claim 2, wherein the fourth orientation is an orientation that corresponds to a plane parallel to the display screen.

4. The display control device according to claim 1, wherein the CPU is further configured to:

change the second position where the first object is displayed and the second orientation of the first object in the display of the second image to correspond to the third position where the first object is displayed and the third orientation of the first object in the display of the third image, and

control the display screen transition from the display of the second image to the display of the third image.

5. The display control device according to claim 1, wherein the CPU is further configured to control the display screen transition the display of the second image to the display of the third image such that the third position where the first object is displayed and the third orientation of the first object in the display of the third image is changed to correspond to the second position where the first object is displayed and the second orientation of the first object in the display of the second image.

6. The display control device according to claim 1, wherein at least one of the third image or the second image is a captured image.

7. The display control device according to claim 1, wherein at least one of the third image or the second image is a virtually created image.

8. The display control device according to claim 1, wherein the CPU is further configured to allow an option to transition to the third image that is displayed after the display of the second image.

9. The display control device according to claim 8, wherein the CPU is further configured to allow the option to be displayed for each attribute of the second image.

10. The display control device according to claim 1, wherein the CPU is further configured to allow an annotation assigned to the first object in each of the third image and the second image to be displayed in association with the first object in a cumulative manner based on the referred record.

11. A display control method, comprising:

in a display control device comprising a Central Processing Unit (CPU) and a memory configured to store instructions for execution by the CPU;

referring, by the CPU, to a record that corresponds to a first plurality of objects,

wherein the records includes an association of an image id of a first image, an object id of a first object of the first plurality of objects included in the first image, a first position of the first object in the first image, and a first orientation of the first object in the first image;

controlling, a display screen to display a second image including the first plurality of objects; and

controlling the display screen to subsequently display a third image including the first object and a second plurality of objects of the first plurality of objects based on the referred record such that, at least one of a second position of the first object and a third position of the first object in the third image are same or a second orientation of the first object in the second image and a third orientation of the first object in the third image are same,

wherein number of the second plurality of objects are less than number of the first plurality of objects, and

wherein the second image is different from the first image.

12. A non-transitory computer-readable medium having stored thereon, computer-executable instructions for causing a display control device to execute operations, the operations comprising:

referring to a record that corresponds to a first plurality of objects,

wherein the record includes an association of an image id of a first image, an object id of a first object of the first plurality of objects included in the first image, a first position of the first object in the first image, and a first orientation of the first object in the first;

displaying a second image including the first plurality of objects; and

subsequently displaying a third image including the first object and a second plurality of objects of the first plurality of objects based on the referred record such that, at least one of a second position of the first object and a third position of the first object in the third image are same or a second orientation of the first object in the second image and a third orientation of the first object in the third image are same,

wherein number of the second plurality of objects are less than number of the first plurality of objects, and

wherein the second image is different from the first image.