NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM, CONTROL METHOD, AND COMPUTER

• US 20170237892A1
• Filed: 01/31/2017
• Published: 08/17/2017
• Est. Priority Date: 02/16/2016
• Status: Active Grant

• Current Assignee: Fujitsu Limited
• Original Assignee: Fujitsu Limited
• Inventors: Sakai, Takafumi
• Granted Patent: US 9,906,702 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

A control method executed by a computer including acquiring a first image, acquiring a first location of the target by using a wireless positioning system, displaying the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate determined based on the first location of the target, acquiring a second image, acquiring a second location of the target when a specified period of time elapses after the first location is acquired, acquiring a distance of movement of the target during the specified period of time by using an inertial sensor, making a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate based on the distance of movement, the second location coordinate being determined based on the second location.

Claims

1. A non-transitory computer-readable storage medium storing a control program that causes a computer to execute a process, the process comprising:

acquiring a first image;

acquiring a first location of the target by using a wireless positioning system, the first location corresponding to the first image;

displaying the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate on the first image, the first location coordinate being determined based on the first location of the target;

acquiring a second image after the first image is acquired;

acquiring a second location of the target by using the wireless positioning system when a specified period of time elapses after the first location is acquired, the second location corresponding to the second image;

acquiring a distance of movement of the target during the specified period of time by using an inertial sensor included in the target;

making a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate on the second image data based on the distance of movement, the second location coordinate being determined based on the second location of the target; and

displaying the second image and the display information that is superimposed on the second image based on the determination.

2. The non-transitory computer-readable storage medium according to claim 1, wherein

each of the first image and the second image is captured by the target.

3. The non-transitory computer-readable storage medium according to claim 1, wherein the process comprises:

when the distance of movement is less than a first predetermined value, making a determination that the display information is to be displayed with associating with the first location coordinate.

4. The non-transitory computer-readable storage medium according to claim 3, wherein

the first predetermined value is determined based on a speed at which a person walks or a distance which a person moves by walking in a predetermined period of time.

5. The non-transitory computer-readable storage medium according to claim 3, wherein the process further comprises:

when a difference between the first location and the second location is greater than a second predetermined value greater than the first predetermined value, making the determination that the display information is to be displayed with associating with the first location coordinate.

6. The non-transitory computer-readable storage medium according to claim 3, wherein

the second predetermined value is determined based on a speed at which a person walks or a distance which a person moves by walking in a predetermined period of time and based on tolerance of location measurement using the wireless positioning system.

7. The non-transitory computer-readable storage medium according to claim 3, wherein the process comprises:

when the distance of movement is equal to or greater than the first predetermined value, making a determination that the display information is to be displayed with associating with the second location coordinate.

8. The non-transitory computer-readable storage medium according to claim 1, wherein

the image data is a motion image captured by an imaging device.

9. The non-transitory computer-readable storage medium according to claim 1, wherein

the inertial sensor includes at least one of a gyro sensor and an acceleration sensor.

10. The non-transitory computer-readable storage medium according to claim 1, wherein

the target is the computer.

11. The non-transitory computer-readable storage medium according to claim 7, wherein the process further comprises:

upon receipt of an operation designating a location coordinate on the first image data with the display information superposed and displayed thereon, displaying display information different from the display information before the reception of the operation on the image data; and

when a display position of the display information is updated from a position corresponding to the first location coordinate to a position corresponding to the second location coordinate, performing control such that the location coordinate with the display information displayed thereon is considered designated if a designated location coordinate corresponds to the second location coordinate and does not correspond to the first location coordinate, within a predetermined period of time following the update.

12. A control method executed by a computer, the control method comprising:

acquiring a first image;

acquiring a first location of the target by using a wireless positioning system, the first location corresponding to the first image;

displaying the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate on the first image, the first location coordinate being determined based on the first location of the target;

acquiring a second image after the first image is acquired;

acquiring a second location of the target by using the wireless positioning system when a specified period of time elapses after the first location is acquired, the second location corresponding to the second image;

acquiring a distance of movement of the target during the specified period of time by using an inertial sensor included in the target;

making a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate on the second image data based on the distance of movement, the second location coordinate being determined based on the second location of the target; and

displaying the second image and the display information that is superimposed on the second image based on the determination.

13. A computer comprising:

a memory; and

a processor coupled to the memory and the processor configured to;

acquire a first image;

acquire a first location of the target by using a wireless positioning system, the first location corresponding to the first image;

display the first image and display information that is superimposed on the first image, the display information being displayed with associating with a first location coordinate on the first image, the first location coordinate being determined based on the first location of the target;

acquire a second image after the first image is acquired;

acquire a second location of the target by using the wireless positioning system when a specified period of time elapses after the first location is acquired, the second location corresponding to the second image;

acquire a distance of movement of the target during the specified period of time by using an inertial sensor included in the target;

make a determination of whether the display information is to be displayed with associating with the first location coordinate or a second location coordinate on the second image data based on the distance of movement, the second location coordinate being determined based on the second location of the target; and

display the second image and the display information that is superimposed on the second image based on the determination.