DISPLAY CONTROL METHOD AND DEVICE

• US 20180012410A1
• Filed: 06/01/2017
• Published: 01/11/2018
• Est. Priority Date: 07/06/2016
• Status: Abandoned Application

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Koga, Susumu
• Application Number:
  US15/611,145
• Publication Number:
  US 20180012410A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 10/768 using context analysis, e.g. recognition aided by known co-occurring patterns
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices

Abstract

A method includes acquiring an image, acquiring display orders of a plurality of object data that respectively correspond to a plurality of reference objects based on correspondence information in which a reference object is associated with an object data that corresponds to the reference object and a display order of the object data, determining, among the plurality of object data, object data that corresponds to a display subject based on the display orders of the plurality of object data, executing a process that generates display information for displaying the object data that is the display subject, controlling a display to display the object data that is the display subject based on an execution result of the process, and performing the executing of the process for another object data, and the controlling of the display based on the another object data, the another object data being a next display subject.

Claims

1. A method executed by a computer, the method comprising:

acquiring an image captured by a camera;

acquiring display orders of a plurality of object data that respectively correspond to a plurality of reference objects recognized in the image based on correspondence information in which a reference object is associated with an object data that corresponds to the reference object and a display order of the object data;

determining, among the plurality of object data, object data that corresponds to a display subject based on the display orders of the plurality of object data;

executing a process that generates display information for displaying the object data that is the display subject;

controlling a display to display the object data that is the display subject based on an execution result of the process; and

performing the executing of the process for another object data among the plurality of object data, and the controlling of the display based on the another object data, the another object data being a next display subject subsequent to the display subject based on the display orders.

2. The method according to claim 1, wherein the process includes:

calculating a vector that indicates an axis of a specific reference object with which the object data that is the display subject is associated, and

determining a display position of the object data that is the display subject on the display based on the vector.

3. The method according to claim 2, wherein the vector is expressed by a transfer matrix and a rotation matrix of the specific reference object in a coordinate system defined by an photographing position and an photographing orientation of the camera.

4. A method executed by a computer, the method comprising:

acquiring a plurality of object data that are respectively associated with a plurality of reference objects detected in an image captured by a camera, and respective display orders of the plurality of object data, based on correspondence information in which object data, a display order of the object data, and a reference object that corresponds to the object data are associated; and

respectively displaying the plurality of object data on a display in order based on the display order.

5. The method according to claim 4, further comprising:

setting a display time of specific object data, among a portion of object data displayed on the display, to be longer in a case in which selection of the specific object data is received than in a case in which the selection is not received.

6. The method according to claim 4, further comprising:

setting a display time of object data related to an alarm to be longer than a display time of another object data.

7. The method according to claim 4, wherein the display order of object data related to an alarm is set to have priority.

8. The method according to claim 4, wherein the display order is set according to an editing date and time order of the object data.

9. The method according to claim 4, wherein the displaying includes calculating display information only for the object data that is a display subject determined based on the display order.

10. The method according to claim 4, wherein the display information is a vector that indicates an axis of the reference object.

11. A device comprising:

a memory; and

a processor coupled to the memory and configured to;

acquire an image captured by a camera,

acquire display orders of a plurality of object data that respectively correspond to a plurality of reference objects recognized in the image based on correspondence information in which a reference object is associated with an object data that corresponds to the reference object and a display order of the object data,

determine, among the plurality of object data, object data that corresponds to a display subject based on the display orders of the plurality of object data,

execute a process that generates display information for displaying the object data that is the display subject,

control a display to display the object data that is the display subject based on an execution result of the process, and

perform a execution of the process for another object data among the plurality of object data, and a control of the display based on the another object data, the another object data being a next display subject subsequent to the display subject based on the display orders.

12. The device according to claim 11, wherein the process includes:

calculating a vector that indicates an axis of a specific reference object with which the object data that is the display subject is associated, and

determining a display position of the object data that is the display subject on the display based on the vector.

13. The device according to claim 12, wherein the vector is expressed by a transfer matrix and a rotation matrix of the specific reference object in a coordinate system defined by an photographing position and an photographing orientation of the camera.