System for and method of interfacing with a three dimensional display

• US 8,601,402 B1
• Filed: 09/29/2009
• Issued: 12/03/2013
• Est. Priority Date: 09/29/2009
• Status: Active Grant

• Current Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Original Assignee: Rockwell Collins, Inc. (Raytheon Technologies Corporation d/b/a RTX)
• Inventors: Habboub, Bassell
• Primary Examiner(s): Roswell, Michael
• Application Number:
  US12/569,815
• Time in Patent Office: 1,526 Days
• Field of Search: 715/863, 715/848, 715/782, 715/810
• US Class Current: 715/863
• CPC Class Codes: G01S 13/953 mounted on aircraft
• CPC Class Codes: G01S 7/20 Stereoscopic displays; Three-dimensional displays; Pseudo-three-dimensional displays
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/042 by opto-electronic means
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/0034 Assembly of a flight plan
• CPC Class Codes: G08G 5/0052 for cruising combined instruments indicating more than one navigational value G01C23/00
• CPC Class Codes: G08G 5/0091 for monitoring atmospheric conditions radar or analogous systems specially adapted for meteorological use G01S13/95; meteorology G01W
• CPC Class Codes: G09B 29/003 Maps
• CPC Class Codes: G09B 29/12 Relief maps relief models G09B25/06
• CPC Class Codes: G09G 2380/12 Avionics applications
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: Y02A 90/10 Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

An interface for a system includes a three dimensional display and a three dimensional touch screen. The interface includes processing electronics configured to receive information from a three dimensional touch screen and determine at least one of a grab and hold operation for an object displayed in three dimensional space, a zoom operation associated with a finger movement along a Z axis perpendicular to an XY plane of the three dimensional touch screen, a pick and placement operation for an object in three dimensional space, a switching operation associated with a two dimensional object getting three dimensional attributes when moved along the Z axis in a direction away from the XY plane of the screen, and a menu expansion operation associated with a finger movement along the Z axis.

Claims

1. An interface for a system having an X, Y, and Z axis and including a three dimensional display and a three dimensional touch screen, the three dimensional displaying two dimensional images in an XY plane at Z equal to zero, the interface comprising:

processing electronics configured for receiving information from the three dimensional touch screen and determining at least one of a grab and hold operation for an object displayed in three dimensional space, a pick and placement operation for the object in three dimensional space, and a mouse over operation wherein the object in a native two dimensional state gains three dimensional attributes when a finger is near the object and returns to the native two dimensional state when the finger moves away from the object, wherein the three dimensional display provides a two dimensional image of weather information, the weather information including critical weather and ground clutter, wherein the object is the critical weather and is displayed above the XY plane at Z equals zero in three dimensions and is separated from the ground clutter in response to the mouse over operation, the grab and hold operation or the pick and place operation, wherein the mouse over operation, the grab and hold operation or the pick and place operation is initiated by touching the XY plane at Z equals zero.

2. The interface of claim 1, wherein the three dimensional display provides the critical weather based upon severity of weather.

3. The interface of claim 1, wherein a critical alert associated with the critical weather is provided in three dimensional space by the three dimensional display and a menu expansion operation can provide additional information regarding the critical alert.

4. The interface of claim 3, wherein the critical alert can be moved using the pick and placement operation.

5. The interface of claim 4, wherein the display provides a map and buttons, tabs, and icons can be selected and moved in three dimensional space.

6. The interface of claim 1, wherein the display is an avionics display.

7. The interface of claim 1, wherein the display is a targeting display.

8. The interface of claim 1, wherein the user can choose one of a plurality of windows in a stack and move the window through three dimensional space to a new position in the stack.

9. The interface of claim 8, wherein the interface is provided for a flight display.

10. The interface of claim 1, wherein the user can choose one of a plurality of windows in a stack and slide it away from the stack.

11. A method of using a three dimensional display and three dimensional touch screen, the method comprising:

receiving detection signals from the three dimensional touch screen;

determining a movement of a finger from the detection signals; and

moving an object displayed on the three dimensional display in response to the movement, the object being moved according to at least one of a grab and hold operation for the object displayed in three dimensional space, and a pick and placement operation for the object in three dimensional space, wherein the three dimensional display includes an X axis, a Y axis, and a Z axis and provides a two dimensional image of weather information, the weather information including critical weather and ground clutter, wherein the object is the critical weather and is displayed above an XY plane at Z equals zero in three dimensions and is separated from the ground clutter in response to the grab and hold operation or the pick and place operation, wherein the grab and hold operation or the pick and place operation is initiated by touching the XY plane at Z equals zero.

12. The method of claim 11, wherein the object is moved according to the grab and hold operation.

13. The method of claim 11, wherein the critical weather is displayed based upon proximity to flight path.

14. The method of claim 11, wherein the object is moved according to the pick and place operation.

15. The method of claim 11, wherein the ground clutter remains on the weather image in the XY plane at Z equals zero.

16. The method of claim 11, wherein further information about the critical weather in three dimensions is displayed according to a menu expansion operation.

17. The method of claim 11, further comprising:

providing a zoom operation associated with a finger movement along the Z axis perpendicular to the XY plane of the three dimensional touch screen.

18. The method of claim 11, wherein the critical weather is displayed based upon a hazard level.

19. An apparatus, comprising:

a display for providing images of two dimensional and three dimensional objects, the display having an X axis, a Y axis, and a Z axis;

means for sensing a position and movement in three dimensions; and

means for responding to the position and movement to change an object displayed in two dimensions to an object displayed in three dimensions, wherein the means for responding responds to at least one of a grab and hold operation for the object displayed in three dimensional space, a pick and placement operation for the object in three dimensional space, and a mouse over operation, wherein the object in a native two dimensional state gains three dimensional attributes when a finger is near the object and returns to the native two dimensional state when the finger moves away from the object, wherein the display provides a two dimensional image of a weather information including critical weather and ground clutter, wherein the object is the critical weather and is displayed above the XY plane at Z equals zero in three dimensions and is separated from the ground clutter in response to the mouse over operation, the grab and hold operation or the pick and place operation, wherein the mouse over operation, the grab and hold operation or the pick and place operation is initiated by touching the XY plane at Z equals zero.

20. The apparatus of claim 19 wherein the critical weather is classified as critical weather based upon level of hazard or proximity to a flight path.