Image processing apparatus, image processing system, image processing method, and recording medium

• US 10,389,444 B2
• Filed: 09/19/2016
• Issued: 08/20/2019
• Est. Priority Date: 12/28/2015
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Nagasaka, Tomoaki, Yamamoto, Ryohei
• Primary Examiner(s): Bost, Dwayne D
• Assistant Examiner(s): Brinich, Stephen M
• Application Number:
  US15/269,908
• Publication Number:
  US 20170186178A1
• Time in Patent Office: 1,065 Days
• Field of Search: 382106-107, 382100, 382122-123, 434247, 434250, 434258, 434307 A, 434307 R
• CPC Class Codes: H04B 10/116 Visible light communication

Abstract

An image processing apparatus includes an obtainer and an acquirer. The obtainer obtains video information including video of a measurement target and a visible light signal that includes a measurement time and measurement information of the measurement target measured by a measuring apparatus attached to the measurement target, the visible light signal being transmitted by the measuring apparatus. The acquirer acquires the measurement time and the measurement information from the visible light signal included in the video information obtained by the obtainer, and synchronizes, with respect to time, the measurement information and the video information based on the measurement time acquired.

Claims

1. An image processing apparatus comprising:

an obtainer for obtaining video information including video of a measurement target and a visible light signal that includes a measurement time and measurement information for the measurement target measured by a measuring apparatus attached to the measurement target, the visible light signal being emitted by the measuring apparatus; and

an acquirer for acquiring the measurement time and the measurement information from the visible light signal included in the video information obtained by the obtainer, and for synchronizing the measurement information and the video information based on the measurement time acquired,

wherein;

the measurement time indicates an elapsed time from when the measuring apparatus began measuring; and

the acquirer synchronizes the measurement information and the video information by specifying a second time, which is before a first time by the elapsed time indicated by the measurement time, and by specifying a frame of the video information captured at the specified second time, wherein the first time corresponds to a beginning of the measurement information in the visible light signal in the video information.

2. The image processing apparatus according to claim 1, wherein the obtainer is a capturer for capturing the video information.

3. The image processing apparatus according to claim 1, wherein the obtainer is a receiver for receiving the video information from a capturing apparatus that captures the video information.

4. The image processing apparatus according to claim 1, further comprising a display for simultaneously displaying the video information obtained by the obtainer and the measurement information acquired by the acquirer.

5. The image processing apparatus according to claim 1, wherein:

the obtainer obtains the video information including the visible light signal that further includes identification information identifying the measuring apparatus; and

the acquirer acquires the identification information from the visible light signal included in the video information obtained by the obtainer.

6. The image processing apparatus according to claim 1, wherein the obtainer obtains the video information including the visible light signal that further includes an evaluation value calculated by the measuring apparatus analyzing the measuring information.

7. The image processing apparatus according to claim 4, wherein:

the obtainer obtains the video information including the visible light signal that further includes an alert flag indicating that an evaluation value calculated by the measuring apparatus analyzing the measurement information exceeds a threshold value;

the acquirer acquires the alert flag from the visible light signal included in the video information obtained by the obtainer; and

the display displays with highlights a part including the measuring apparatus in the video information, when the acquirer has acquired the alert flag.

8. The image processing apparatus according to claim 4, further comprising a receiver for receiving instructions for selecting a specific measuring apparatus from among a plurality of the measuring apparatuses;

and

the display simultaneously displays the video information and the measurement information of the measurement target to which the selected specific measuring apparatus is attached.

9. The image processing apparatus according to claim 1, wherein the measuring information includes movement information acquired by the measuring apparatus from the measurement target that is moving.

10. The image processing apparatus according to claim 1, wherein the measurement information includes biological information acquired by the measuring apparatus from the measurement target.

11. The image processing apparatus according to claim 1, wherein the measurement information includes environment information acquired by the measuring apparatus from an environment surrounding the measurement target.

12. The image processing apparatus according to claim 1, wherein the visible light signal includes a flashing pattern of visible light.

13. The image processing apparatus according to claim 1, wherein the visible light signal includes a plurality of visible lights which have different wavelengths.

14. An image processing system, comprising:

a measuring apparatus attached to a measurement target, the measuring apparatus measuring a measurement time and measurement information of the measurement target and emitting a visible light signal including the measurement time and the measurement information measured; and

an image processing apparatus including;

an obtainer for obtaining video information that includes the visible light signal and video of the measurement target; and

an acquirer for acquiring the measurement time and the measurement information from the visible light signal included in the video information obtained by the obtainer, and for synchronizing the measurement information and the video information based on the measurement time acquired,

wherein;

the measurement time indicates an elapsed time from when the measuring apparatus began measuring; and

the acquirer of the image processing apparatus synchronizes the measurement information and the video information by specifying a second time, which is before a first time by the elapsed time indicated by the measurement time, and by specifying a frame of the video information captured at the specified second time, wherein the first time corresponds to a beginning of the measurement information in the visible light signal in the video information.

15. An image processing method comprising:

obtaining video information including video of a measurement target and a visible light signal that includes a measurement time and measurement information for the measurement target measured by a measuring apparatus attached to the measurement target, the visible light signal being emitted by the measuring apparatus; and

acquiring the measurement time and the measurement information from the visible light signal included in the video information obtained, and synchronizing the measurement information and the video information based on the measurement time acquired,

wherein;

the measurement time indicates an elapsed time from when the measuring apparatus began measuring; and

the synchronizing of the measurement information and the video information comprises specifying a second time, which is before a first time by the elapsed time indicated by the measurement time, and by specifying a frame of the video information captured at the specified second time, wherein the first time corresponds to a beginning of the measurement information in the visible light signal in the video information.

16. A non-transitory computer-readable recording medium on which is recorded a program for controlling a computer of an image processing apparatus to execute processing comprising:

an obtaining process for obtaining video information including video of a measurement target and a visible light signal that includes a measurement time and measurement information for the measurement target measured by a measuring apparatus attached to the measurement target, the visible light signal being emitted by the measuring apparatus; and

an acquiring process for acquiring the measurement time and the measurement information from the visible light signal included in the video information obtained, and for synchronizing the measurement information and the video information based on the measurement time acquired,

wherein;

wherein;

the measurement time indicates an elapsed time from when the measuring apparatus began measuring; and

the acquiring process synchronizes the measurement information and the video information by specifying a second time, which is before a first time by the elapsed time indicated by the measurement time, and by specifying a frame of the video information captured at the specified second time, wherein the first time corresponds to a beginning of the measurement information in the visible light signal in the video information.

17. An image processing method comprising:

obtaining video information including video of a measurement target and a visible light signal that includes a measurement time and measurement information for the measurement target measured by a measuring apparatus attached to the measurement target and an alert flag indicating that an evaluation value calculated by the measurement apparatus analyzing the measurement information exceeds a threshold value, the visible light signal being emitted by the measuring apparatus;

acquiring the alert flag, the measurement time, and the measurement information from the visible light signal included in the video information obtained, and synchronizing the measurement information and the video information based on the measurement time acquired; and

displaying simultaneously, the synchronized video information and the measurement information,

wherein;

the displaying displays with highlights a part including the measuring apparatus in the video information, when the alert flag has been acquired in the acquiring,

the measurement time indicates an elapsed time from when the measuring apparatus began measuring; and

the synchronizing of the measurement information and the video information comprises specifying a second time, which is before a first time by the elapsed time indicated by the measurement time, and by specifying a frame of the video information captured at the specified second time, wherein the first time corresponds to a beginning of the measurement information in the visible light signal in the video information.