REMOTE MANAGED BALLAST WATER TREATMENT SYSTEM USING AUGMENTED REALITY

• US 20160176724A1
• Filed: 08/19/2014
• Published: 06/23/2016
• Est. Priority Date: 12/12/2013
• Status: Active Grant

• Current Assignee: Hanla IMS Co., Ltd.
• Original Assignee: Hanla IMS Co., Ltd.
• Inventors: Ji, Suk Joon, Kim, Young Gu, Cho, In Tae, Choi, Woo Jin, Lee, Kwang Seob, Lee, Chae Ho, Kim, Chang Kook
• Granted Patent: US 10,131,549 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B63J 4/00 Arrangements of installations for treating ballast water, waste water, sewage, sludge, or refuse, or for preventing environmental pollution not otherwise provided for; centrifugal bilge-water separators B04; discharge of refuse, e.g. for ash B63B17/06; arrangements on tanks for fuel or the like for minimizing pollution by accidents B63B17/0036, associated with cargo tanks B63B25/082; vessels for collecting pollution from open water B63B35/30; soil-water discharges B63B29/16; treating waste water, sewage, or sludge, in general, C02F; cleaning or keeping clear the surface of open water, in general E02B15/00
• CPC Class Codes: B63J 4/002 for treating ballast water
• CPC Class Codes: C02F 1/008 Control or steering systems not provided for elsewhere in subclass C02F
• CPC Class Codes: C02F 2103/008 Originating from marine vessels, ships and boats, e.g. bilge water or ballast water
• CPC Class Codes: C02F 2209/008 comprising telecommunication features, e.g. modems or antennas
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 2219/32014 Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

The present invention relates to a remote managed ballast water treatment system using augmented reality, in particular, a ballast water treatment system (hereinafter, referred to as “BWTS”) which receives operation and failure information from various sensors installed in each component within a device, the remote managed ballast water treatment system comprising: an augmented reality terminal having a software application installed therein, which can recognize each component of the BWTS through shape information in a shot image while shooting a real-time image and provides information on a state of the BWTS and information required for the BWTS (provides augmented reality information), through a computer graphic image, in addition to a real-time image of reality; an augmented reality maintenance apparatus for the BWTS, the apparatus comprising a BWTS interface, an augmented reality interface, a satellite communication interface, and a control unit; and a remote management system of a terrestrial base station which shares sensing information of the BWTS and real-time image information of the augmented reality terminal with satellite communication through the satellite communication interface, wherein, when BWTS maintenance information has been sent from the remote management system of the terrestrial base station during a BWTS failure, the control unit outputs a failure point and repair information as augmented reality image information to the augmented reality terminal, a failure treatment method is guided to a user as a real-time augmented reality image, and the terrestrial base station supervises a failure treatment process of the BWTS through a real-time image.

Claims

1. A remote managed ballast water treatment system using augmented reality, a ballast water treatment system (hereinafter, referred to as “

BWTS”

) which receives operation and failure information from various sensors installed in each component within a device, the remote managed ballast water treatment system comprising;

an augmented reality terminal having a software application installed therein, which can recognize each component of the BWTS through shape information in a shot image while shooting a real-time image and provides information on a state of the BWTS and information required for the BWTS (provides augmented reality information), through a computer graphic image, in addition to a real-time image of reality;

an augmented reality maintenance apparatus for the BWTS, the apparatus comprising a BWTS interface, an augmented reality interface, a satellite communication interface, and a control unit;

wherein the BWTS interface which receives operation and failure information of the BWTS from various sensors installed in the BWTS;

the augmented reality interface which receives real-time image information from the augmented reality terminal or outputs the real-time image information to the augmented reality terminal;

the satellite communication interface connected to an external satellite communication device to perform transmission/reception with a remote terrestrial base station; and

the control unit which calculates information input through the BWTS interface, the augmented reality interface, and the satellite communication interface to output the calculated information; and

a remote management system of a terrestrial base station which shares sensing information of the BWTS and real-time image information of the augmented reality terminal with satellite communication through the satellite communication interface,

wherein, when BWTS maintenance information has been sent from the remote management system of the terrestrial base station during a BWTS failure, the control unit outputs a failure point and repair information as augmented reality image information to the augmented reality terminal, a failure treatment method is guided to a user as a real-time augmented reality image, and the terrestrial base station supervises a failure treatment process of the BWTS through a real-time image.

2. The remote managed ballast water treatment system of claim 1, wherein a marker or a bar code is attached to each part of the BWTS that the augmented reality terminal recognizes while photographing a real-time image, and

the augmented reality terminal recognizes shapes of the parts of the BWTS and an output position of a processed computer graphic image by the marker or the bar code.

3. The remote managed ballast water treatment system of claim 2, wherein the augmented reality terminal comprises a smart phone or a head up device (HUD) including a software application for additionally providing a computer graphic virtual image to a real-time image of a real environment.

4. The remote managed ballast water treatment system of claim 1, wherein the control unit comprises a memory for storing a failure processing manual with respect to various sensing signals input from the BWTS as augmented reality image information and guides general failure processing of the BWTS to be soon realized as augmented reality.

5. The remote managed ballast water treatment system of claim 1, wherein the remote management system of the terrestrial base station comprises a program for diagnosing state information of the BWTS received from a satellite network to determine whether or not the remote management system is normal and to diagnose and estimate a failure of the BWTS to monitor the state information of the BWTS in real time, and outputs a maintenance command of the BWTS or a maintenance operation command of the BWTS when the failure of the BWTS is estimated through an augmented reality interface.