Method for synchronizing data collected from a camera device and a motion sensing device and data processing device generating the synchronized data

• US 10,016,654 B2
• Filed: 03/20/2015
• Issued: 07/10/2018
• Est. Priority Date: 03/21/2014
• Status: Active Grant

• Current Assignee: GOLFZON Co., Ltd.
• Original Assignee: GOLFZON Co., Ltd.
• Inventors: Park, Hyun Jin
• Primary Examiner(s): Misleh, Justin P
• Application Number:
  US15/127,793
• Publication Number:
  US 20170117019A1
• Time in Patent Office: 1,208 Days
• Field of Search: None
• CPC Class Codes: A63B 2220/05 Image processing for measuring physical parameters
• CPC Class Codes: A63B 2220/62 Time or time measurement used for time reference, time stamp, master time or clock signal
• CPC Class Codes: A63B 2220/803 Motion sensors
• CPC Class Codes: A63B 2220/806 Video cameras
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: A63B 69/3608 Attachments on the body, e.g. for measuring, aligning, restraining A63B69/0059, A63B69/3673 take precedence
• CPC Class Codes: G09B 19/0038 Sports
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

Provided is a method for synchronizing data between different types of devices for collecting and processing data with respect to a moving object, comprising: sampling first type data with respect to a motion of the object from one device; sampling second type data with respect to a motion of the object from another device having a larger sampling interval than the device; and generating data corresponding to a sampling time of the first type data by combining second type data respectively sampled before and after the sampling time of the first type data in a sampling interval of the second type data, to generate data synchronized with the sampling time of the first type data with respect to the second type data.

Claims

1. A method for synchronizing data between a camera device for collecting image data with respect to a moving object and a motion sensing device for collecting motion sensing data with respect to the moving object, comprising:

sampling the image data with respect to the moving object from the camera device;

sampling the motion sensing data with respect to the moving object from the motion sensing device; and

generating synchronized image data corresponding to a sampling time of the motion sensing data by composing the sampled image data respectively sampled before and after the sampling time of the motion sensing data in a sampling interval of the image data, wherein the synchronized image data is synchronized with the sampling time of the motion sensing data, the synchronized image data generated by;

calculating weights for the sampled image data, the weights increasing as the sampled image data approaches the sampling time of the motion sensing data;

respectively applying the calculated weights to the sampled image data respectively sampled before and after the sampling time of the motion sensing data; and

composing the weights applied image data to generate the synchronized image data corresponding to the sampling time of the motion sensing data.

2. The method according to claim 1, wherein the generating of the synchronized image data comprises generating image data synchronized with the sampling time of the motion sensing data by applying weights, calculated on the basis of sampling times of two image data close to the sampling time of the motion sensing data and a sampling interval of the motion sensing data, to the image data and composing the image data.

3. The method according to claim 1, wherein the generating of the synchronized image data comprises:

calculating a ratio of an interval between the sampling time of the motion sensing data and a sampling time of first image data corresponding to image data before the motion sensing data sampling time to the sampling interval of the image data as a second weight;

calculating a ratio of an interval between the sampling time of the motion sensing data and a sampling time of second image data corresponding to image data after the motion sensing data sampling time to the sampling interval of the image data as a first weight; and

applying the first weight to the first image data, applying the second weight to the second image data and composing the first image data and the second image data to which the first and second weights have been respectively applied.

4. The method according to claim 3, wherein the composing of the image data comprising:

applying the first weight to values of all pixels of the first image data and applying the second weight to values of all pixels of the second image data; and

summing pixel values to which the first weight has been applied and pixel values respectively corresponding to the pixel values and weighted by the second weight, to generate composite image data having the summed pixel value.

5. The method according to claim 1, further comprising generating images based on the image data synchronized with the motion sensing data sampling time and including an image generated based on the motion sensing data and displayed thereon.

6. A data processing device for generating synchronized data between a camera device for collecting image data with respect to a moving object and a motion sensing device for collecting motion sensing data with respect to the moving object, the data processing device generating the synchronized data according to the method of claim 1.

7. The data processing device according to claim 6, wherein the data processing device is further configured to calculate a ratio of an interval between the sampling time of the motion sensing data and a sampling time of first image data corresponding to image data before the motion sensing data sampling time to the sampling interval of the image data as a second weight and to calculate a ratio of an interval between the sampling time of the motion sensing data and a sampling time of second image data corresponding to image data after the motion sensing data sampling time to the sampling interval of the image data as a first weight.

8. The data processing device according to claim 7, wherein the data processing device is further configured to apply the first weight to values of all pixels of the first image data, to apply the second weight to values of all pixels of the second image data and to sum pixel values to which the first weight has been applied and pixel values respectively corresponding to the pixel values and weighted by the second weight, to generate composite image data having the summed pixel value.

9. The data processing device according to claim 6, wherein the data processing device is further configured to generate images based on the image data synchronized with the motion sensing data sampling time and including an image generated based on the motion sensing data and displayed thereon.