Method and apparatus for a virtual mission control station

• US 8,773,330 B2
• Filed: 06/25/2009
• Issued: 07/08/2014
• Est. Priority Date: 06/25/2009
• Status: Active Grant

• Current Assignee: The Boeing Co.
• Original Assignee: The Boeing Co.
• Inventors: Edwards, Richard E., Kesterson, Bryan P., Boutros, Ramzy, Hornsby, Mary E.
• Primary Examiner(s): Lubit, Ryan A
• Application Number:
  US12/491,339
• Publication Number:
  US 20100328204A1
• Time in Patent Office: 1,839 Days
• Field of Search: 345 7- 9, 701/3
• US Class Current: 345/8
• CPC Class Codes: A47C 7/624 located on side of seat, e.g. on armrest
• CPC Class Codes: A47C 7/70 of foldable type
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A method and apparatus for performing a mission. Information for a mission is received at a control station. The control station comprises a display system, a motion capture system, a number of user input devices, a seat associated with the number of user input devices, and a processor unit. The display system is configured to be worn on the head of an operator and to present a display to the operator. The motion capture system is configured to track movement of the head. The processor unit is configured to execute program code to generate the display and adjust the display presented to the operator in response to detecting movement of the head of the operator. The mission is performed using the information and the control station.

Claims

1. A first control station located in a first platform, the first control station comprising:

a control system configured to receive information for a mission to be performed collaboratively using the information and the first control station and a control station;

a display system configured to;

be worn on a head of an operator of the first control station, and to present a display to the operator, such that the display comprises three virtual representations of physical windows presenting data, each of the three virtual representations configured to move relative to the other two, the display being configured to;

remain stationary in three dimensions relative to the first control station during movement of the head, the display system further configured to communicate within the first platform and between the first platform and a second platform, and exchange information for collaborative problem solving with the second control station, the second control station being in one of;

the first platform, and the second platform, such that when the first control station and the second control station are both located in the first platform, each physical window is reconfigurable to be visible by a first operator at the first control station in the first platform and a second operator at the second control station in the first platform simultaneously while the first operator at the first control station and the second operator at the second control station are visible to each other;

an inertial sensor motion capture system configured to track movement of the head;

a user input device configured to adjust;

a size, an orientation, and arrangement of a number of displays in the display system;

a seat associated with the user input device, wherein the seat has a side, and further wherein the side has an arm, wherein the arm comprises a stowage area;

a control station oxygen system comprising;

an oxygen source, and a conduit system comprising tubing, the oxygen source and the tubing being in a location consisting of at least one of;

attached to the seat, within the seat, and as a part of the seat;

a work surface, such that the work surface is pivotally connected to a mount, such that the mount and the work surface retractably store within the stowage area of the arm; and

a processor unit in communications with the display system, the motion capture system, and the user input device, wherein the processor unit is configured to execute program code to generate the display and adjust the display presented to the operator in response to detecting movement of the head of the operator.

2. The first control station of claim 1 further comprising:

safety equipment associated with the seat.

3. The first control station of claim 1, wherein the oxygen source is an oxygen tank.

4. The first control station of claim 1, wherein the user input device is selected from at least one of a keyboard, a trackball, a hand controller, a foot controller, a gesture detection system, a mouse, a fingertip tracking system, a microphone, and a joy stick.

5. The first control station of claim 1, wherein the seat is an adjustable seat.

6. The first control station of claim 1, wherein the seat comprises:

a frame;

the arm, which is a first arm associated with the frame;

a second arm associated with the frame;

a first work surface, of the work surface, moveably attached to the first arm; and

a second work surface, of the work surface, moveably attached to the second arm, wherein the first work surface and the second work surface are configured to move between a deployed state and a closed state, and the first work surface and the second work surface form a single work surface when in the deployed state.

7. The first control station of claim 6, wherein the first work surface is configured to slide along the first arm and the second work surface is configured to slide along the second arm.

8. The first control station of claim 6, wherein the user input device comprises a keyboard having a first section attached to the first work surface and a second section attached to the second work surface.

9. The first control station of claim 7, wherein the user input device further comprises a pointing device attached to one of the first work surface and the second work surface.

10. The first control station of claim 1, wherein the processor unit is located in at least one of a data processing system associated with the seat, the display system, and a remote data processing system.

11. The first control station of claim 1, wherein the first platform is selected from one of a stationary platform, a land-based structure, an aquatic-based structure, a space-based structure, an aircraft, a surface ship, a tank, a personnel carrier, a train, a spacecraft, a space station, a submarine, an automobile, an airline operations center, a power plant, a manufacturing facility, an unmanned vehicle control center, and a building.

12. The first control station of claim 11, wherein the user input device is configured to control operation of the platform.

13. A method for performing a mission, the method comprising:

receiving, at a control system, information for the mission;

performing the mission using the information and a first control station collaboratively with a second control station, such that using the first control station comprises;

presenting, using a display system configured to be worn on a head of a first operator, a display to the first operator at the first control station;

presenting the display comprising three virtual representations of physical windows presenting data, each of the three virtual representations being movable relative to the other two, the display being configured to remain stationary in three dimensions relative to the first control station during a movement of the head, the display system further configured to communicate within a first platform and between the first platform and a second platform, and exchange information for collaborative problem solving with the second control station, the second control station being in one of;

the first platform, and the second platform, such that when the first control station and the second control station are both located in the first platform, each physical window being reconfigurable to be visible by the first operator at the first control station in the first platform and a second operator at the second control station in the first platform simultaneously while the first operator at the first control station and the second operator at the second control station are visible to each other;

tracking, using an inertial sensor motion capture system, the movement of the head;

associating a user input device configured to adjust;

a size, an orientation, and arrangement of a number of displays in the display system, with a seat associated with the first control station, the seat comprising;

a side, the side comprising an arm, wherein the arm comprises a stowage area;

a work surface, such that the work surface is pivotally connected to a mount, wherein the mount and the work surface retractably store within the stowage area of the arm;

a processor unit configured to execute program code to generate the display and adjust the display presented to the operator in response to detecting movement of the head of the first operator; and

an oxygen system comprising;

an oxygen source, and a conduit system comprising tubing, the oxygen source and the tubing being in a first location consisting of at least one of;

attached to the seat, within the seat, and as a part of the seat.

14. The method of claim 13 further comprising:

displaying the information using the display system;

receiving user input at the user input device; and

generating a control signal.

15. The method of claim 13, wherein the first control station is located remote to the first platform.

16. The method of claim 15, remote to the first platform comprising one of:

a stationary platform, a land-based structure, an aquatic-based structure, a space-based structure, an aircraft, a surface ship, a tank, a personnel carrier, a train, a spacecraft, a space station, a submarine, an automobile, an airline operations center, a power plant, a manufacturing facility, an unmanned vehicle control center, and a building.