Video or information processing method and processing apparatus, and monitoring method and monitoring apparatus using the same

• US 6,335,722 B1
• Filed: 10/24/1994
• Issued: 01/01/2002
• Est. Priority Date: 04/08/1991
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Tanikoshi, Koichiro, Tanifuji, Shinya, Tani, Masayuki, Yamaashi, Kimiya, Futakawa, Masayasu, Hirota, Atsuhiko, Nishikawa, Atsuhiko
• Primary Examiner(s): Mengistu, Amare
• Application Number:
  US08/328,566
• Time in Patent Office: 2,626 Days
• Field of Search: 395/155-161, 364/138, 364/139, 345/156, 345/157, 345/113, 345/185, 348/15
• US Class Current: 345/173
• CPC Class Codes: G05B 23/0216 Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration
• CPC Class Codes: G05B 23/0267 Fault communication, e.g. human machine interface [HMI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Abstract

In a remote operation monitoring system and the like, it is a video processing apparatus capable of intuitively grasping an object operated by an operator and an operation result. The video processing apparatus includes a unit (310, 320, 2104, 2202) for storing information about at least one object displayed on a screen of a display unit; a unit (12, 2105) for designating information about the object; a unit (300, 2201) for searching the store unit based upon the designated information, and for obtaining information within the store unit corresponding to the designated information; and also a unit (20, 2103) for performing a process related to the object based on the obtained information. An operator can readily grasp an object to be operated and a result.

Claims

1. An interactive live video image operating apparatus, for performing information processing using stored data to control at least one apparatus, including stored at least one of audio and video data related to said at least one apparatus, a live video image of said at least one apparatus photographed live by a video camera being displayed live on a screen of a display means, comprising:

a data memory for storing said control data and said at least one of audio and video data with respect to said at least one apparatus;

a means for designating a subject apparatus of said at least one apparatus by designating a subject live video image corresponding to said subject apparatus being displayed live on said display means;

a means for searching said data memory based on a designated said subject apparatus to obtain said control data and said at least one of audio and video data corresponding to said subject apparatus;

a means for relating said control data with said at least one of audio and video data;

a means for using a related data obtained from said means for relating to control said subject apparatus;

a first reproducing means for reproducing said control data;

a second reproducing means for reproducing said at least one of said audio data and said video data; and

an output means,

wherein said means for relating includes means for storing information for relating said control data to said at least one of said audio data and said video data,

wherein said output means including;

a first output means for outputting a measurement data with respect to said subject apparatus;

a second output means for outputting a reproduced said et least one of said audio data and said video data;

a synchronizing means for controlling said first and second output means in such a manner that an outputted said control data is synchronized with said at least one of said audio data and said video data based on said related,

wherein said second output means further includes;

a direction/speed designating means for designating at least one of a reproducing direction and a reproducing speed with respect to said at least one of said audio data and said video data; and

a means for reproducing said at least one of said audio data and said video data at a designated reproducing speed and a designated reproducing direction.

2. An interactive live video image operating apparatus as claimed in claim 1, further comprising an input storage means for storing operation input information of an operator;

and

wherein said output means includes third output means for outputting said operation input information of said operator in synchronism with reproduction of said at least one of said video data and said audio data.

3. An interactive live video image operating apparatus as claimed in claim 1, further comprising time designating means for designating a time instant when a control data is reproduced, and

wherein said synchronizing means instructs said first output means in such a manner that said at least one of said video data or said audio data is outputted at a time very close to said time instant when said control data is reproduced.

4. An interactive live video image operating apparatus as claimed in claim 3, wherein said time designating means includes a means for accepting a search value of said control data;

said synchronizing means includes a means for searching for designated said control data with respect to said time instant search value; and

said first output means includes a means for outputting both of said time instant and said control data with respect to said time instant.

5. An interactive live video image operating apparatus as claimed in any one of the preceding claims 1 to 4, wherein

said synchronizing means includes:

a means for determining a display degree of said control data in accordance with a reproducing speed of said at least one of said video data and said audio data; and

a means for displaying said control data at a determined said display degree in synchronization with reproduction of said at least one of said audio data and said video data.

6. An interactive live video image operating apparatus as claimed in any one of the preceding claims 4 to 5, wherein said designating means includes a means for accepting a control display degree of said control data;

wherein said first output means includes a means for displaying said control data in accordance with a determined said control display degree;

said synchronizing means includes a means for determining a reproducing speed from said determined said control display degree; and

said first output means includes a means for outputting said video data and said audio data at a determined speed.

7. An interactive live video image operating apparatus, an information processing apparatus for storing data to control an object (referred to “

control datal hereinafter), and also for storing either audio, or video data related to said object, comprising;

means for relating the control data with the audio, or video data; and

means for relating the control data with the audio, or video data based upon said relating means to be outputted;

an information processing apparatus, wherein;

first reproducing means for reproducing said control data, and second reproducing means for reproducing at least one of said audio data and said video data are further comprised;

said relating means includes means for storing information for relating said control data to said audio data, or said video data;

an output means which includes;

first output means for outputting said reproduced measurement data;

second output means for outputting said reproduced sound data, or said reproduced video data;

synchronizing means for controlling said first and second output means in such a manner that said outputted control data is synchronized with said audio data, or said video data based on said relating information to be outputted;

further comprising an input storage means for storing operation input information of an operator; and

wherein said output means includes third output means for outputting said operation input information of said operator in synchronism with reproduction of said at least one of said video data and said audio data;

further comprising an accepting means for accepting operation input information; and

wherein said synchronizing means includes a means for searching said at least one of said video and said audio data acquired at a time very close to a time when an accepted said operation input information is inputted; and

said second output means includes a means for controlling said third output means to output said operation input information in synchronism with reproduction of said at least one of said video data and said audio data by said second output means.