Setting method and information processing device

• US 10,078,914 B2
• Filed: 08/04/2014
• Issued: 09/18/2018
• Est. Priority Date: 09/13/2013
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Koga, Susumu
• Primary Examiner(s): Patel, Jitesh
• Application Number:
  US14/450,707
• Publication Number:
  US 20150077435A1
• Time in Patent Office: 1,506 Days
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A setting method executed by a computer includes acquiring display data to be associated with a reference object detected from a first input image data and to be displayed when the reference object is detected from another input image, generating, by the computer, attitude information indicating an arrangement attitude of the display data relative to the reference object, based on rotation information indicating a magnitude of rotation that is applied to the computer by a user, and storing, in a storage device, setting information including the attitude information, the display data, and identification information of the reference object.

Claims

1. A setting method executed by a computer, comprising:

acquiring first input image data;

acquiring display data, to be associated with a reference object detected from the first input image data;

generating attitude information indicating a display inclination of the display data based on rotation information related to a rotation operation of the computer by a user, the rotation information indicating an attitude of the computer relative to a reference axis in the computer;

generating setting information in which the attitude information and the display data are associated with each other for each of a plurality of reference objects based on the generated attitude information;

storing the generated setting information in a storage device;

acquiring another input image data;

determining whether the reference object is included in the another input image data;

retrieving the attitude information and the display data corresponding to the reference object from the setting information in the storage device when it is determined that the reference object is included in the another input image data;

acquiring position information of the reference object detected from the another input image data, the position information being different from the attitude information; and

displaying the display data on the another input image data based on the attitude information and the position information so that the display data is displayed at an inclination corresponding to the display inclination retrieved from the setting information in the storage device generated using the first input image data.

2. The setting method according to claim 1, wherein the rotation information represents a magnitude of rotation between a first point in time when the reference object has been detected from the first input image data and a second point in time later than the first point in time.

3. The setting method according to claim 1, wherein the attitude information represents the display inclination of the display data relative to each reference axis of a three-dimensional space with respect to the reference object.

4. The setting method according to claim 1, further comprising:

acquiring a first figure data of the reference object from the first input image data, when the reference object is detected from the first input image data;

acquiring a second figure data of the reference object from a second input image data which is input later than the first input image data, when the reference object is detected from the second image data; and

specifying the attitude of the computer based on a difference between the first figure data and the second figure data.

5. The setting method according to claim 1, further comprising:

acquiring a first capturing direction of an imaging device at a first time when the first input image data is captured, the first input image data being captured by the imaging device which is installed on the computer;

acquiring a second capturing direction of the imaging device at a second time when a second input image data is captured, the second input image data being captured by the imaging device; and

specifying the attitude of the computer based on a difference between the first capturing direction and the second capturing direction.

6. The setting method according to claim 1, further comprising:

acquiring the attitude of the computer from a sensor that is installed on the computer and measures an inclination relative to the reference axis set in the computer.

7. The setting method according to claim 1, wherein the reference object is an augmented reality (AR) marker.

8. The setting method according to claim 1, further comprising:

initializing the acquiring the display data based on detecting the reference object from the first input image data.

9. The setting method according to claim 8, further comprising:

displaying an object for initializing editing the attitude information when detecting the reference object from the first input image data, wherein

the acquiring the display data is initialized when the object is operated by the user.

10. The setting method according to claim 1, further comprising:

displaying a template selection screen on a display of the computer, the template selection screen having a plurality of selectable display data, the plurality of selectable display data being stored in the storage device prior to a capturing of the first input image data, wherein

the acquiring includes acquiring the display data among the plurality of selectable display data.

11. The setting method according to claim 1, wherein the setting information includes:

position coordinates and rotational coordinates of the display data relative to an origin of a marker included in the first input image data, and

magnifications with respect to the display data.

12. An information processing device comprising:

a memory; and

a processor coupled to the memory and configured to;

acquire first input image data,

acquire display data to be associated with a reference object detected from first input image data,

generate attitude information indicating a display inclination of the display data based on rotation information related to a rotation operation of the information processing device by a user, the rotation information indicating an attitude of the information processing device relative to a reference axis set in the information processing device,

generate setting information in which the attitude information and the display data are associated with each other for each of a plurality of reference objects based on the generated attitude information,

store the generated setting information in a storage device,

acquire another input image data,

determine whether the reference object is included in the another input image data,

retrieve the attitude information and the display data corresponding to the reference object from the setting information in the storage device when it is determined that the reference object is included in the another input image data,

acquire position information of the reference object detected from the another input image data, the position information being different from the attitude information, and

display the display data on the another input image data based on the attitude information and the position information so that the display data is displayed at an inclination corresponding to the display inclination retrieved from the setting information in the storage device generated using the first input image data.

13. The information processing device according to claim 12, wherein the rotation information represents a magnitude of rotation between a first point in time when the reference object has been detected from the first input image data and a second point in time later than the first point in time.

14. The information processing device according to claim 12, wherein the attitude information represents the display inclination of the display data relative to each reference axis of a three-dimensional space with respect to the reference object.

15. The information processing device according to claim 12, wherein the processor is further configured to:

acquire a first figure data of the reference object from the first input image data, when the reference object is detected from the first input image data;

acquire a second figure data of the reference object from a second input image data which is input later than the first input image data, when the reference object is detected from the second image data; and

specify the attitude of the information processing device based on a difference between the first figure data and the second figure data.

16. The information processing device according to claim 12, wherein the processor is further configured to:

acquire a first capturing direction of an imaging device at a first time when the first input image data is captured, the first input image data being captured by the imaging device which is installed on the information processing device;

acquire a second capturing direction of the imaging device at a second time when a second input image data is captured, the second input image being captured by the imaging device; and

specify the attitude of the information processing device based on a difference between the first capturing direction and the second capturing direction.

17. The information processing device according to claim 12, wherein the processor is further configured to:

acquire the attitude of the information processing device from a sensor that is installed on the information processing device and measures an inclination relative to the reference axis set in the information processing device.

18. A non-transitory computer-readable medium storing a setting program that causes a computer to execute a process, the process comprising:

acquiring first input image data;

acquiring display data, to be associated with a reference object detected from the first input image data;

generating attitude information indicating a display inclination of the display data based on rotation information related to a rotation operation of the computer by a user, the rotation information indicating an attitude of the computer relative to a reference axis set in the computer;

generating setting information in which the attitude information and the display data are associated with each other for each of a plurality of reference objects based on the generated attitude information;

storing the generated setting information in a storage device;

acquiring another input image data;

determining whether the reference object is included in the another input image data;

retrieving the attitude information and the display data corresponding to the reference object from the setting information in the storage device when it is determined that the reference object is included in the another input image data;

acquiring position information of the reference object detected from the another input image data, the position information being different from the attitude information; and

displaying the display data on the another input image data based on the attitude information and the position information so that the display data is displayed at an inclination corresponding to the display inclination retrieved from the setting information in the storage device generated using the first input image data.