Virtual control panel
First Claim
1. A system that enables a user to interact with a virtual control panel for controlling an industrial device or system, the system comprising:
- a pointing object carried and manipulated by the user for interacting with the virtual control panel to control the industrial device or system,a first tracking unit adapted to capture data representing a position of the pointing object,a portable identification element carried and manipulated by the user, the portable identification element being configured to define a position and orientation of the virtual control panel,a second tracking unit adapted to capture data representing a position of the portable identification element,a storage unit configured to store at least one pre-defined graphical interface representing a control panel of the industrial device or system,a graphics unit configured to generate a graphical representation of the control panel based on said stored graphical interface,a registering unit configured to register said graphical representation of the control panel in a fixed relation to said portable identification element, based on said data representing the position of the portable identification element, to produce the virtual control panel,a display unit configured to show the user a view comprising the real world and the virtual control panel projected in a fixed relation to said portable identification element, andan application unit configured communicate with the industrial device or system to perform actions to control the industrial device or system in response to the interactions of the user with the virtual control panel, and configured to determine which actions to control the industrial device or system to perform based on the position of said user controlled pointing object in relation to the identification element.
2 Assignments
0 Petitions
Accused Products
Abstract
A system that enables a user to interact with a virtual control panel using a user controlled pointing object. The system includes a portable identification element, a tracking unit adapted to capture data representing the position of the pointing object and the position of the identification element, a storage unit, storing at least one pre-defined graphical interface representing a control panel of a device, a graphics unit, generating a graphical representation of the control panel, a registering unit, registering the graphical representation of the control panel in a fixed relation to the portable identification element to produce a virtual control panel and a display unit, showing the user a view including the real world and the virtual control panel.
-
Citations
23 Claims
-
1. A system that enables a user to interact with a virtual control panel for controlling an industrial device or system, the system comprising:
-
a pointing object carried and manipulated by the user for interacting with the virtual control panel to control the industrial device or system, a first tracking unit adapted to capture data representing a position of the pointing object, a portable identification element carried and manipulated by the user, the portable identification element being configured to define a position and orientation of the virtual control panel, a second tracking unit adapted to capture data representing a position of the portable identification element, a storage unit configured to store at least one pre-defined graphical interface representing a control panel of the industrial device or system, a graphics unit configured to generate a graphical representation of the control panel based on said stored graphical interface, a registering unit configured to register said graphical representation of the control panel in a fixed relation to said portable identification element, based on said data representing the position of the portable identification element, to produce the virtual control panel, a display unit configured to show the user a view comprising the real world and the virtual control panel projected in a fixed relation to said portable identification element, and an application unit configured communicate with the industrial device or system to perform actions to control the industrial device or system in response to the interactions of the user with the virtual control panel, and configured to determine which actions to control the industrial device or system to perform based on the position of said user controlled pointing object in relation to the identification element. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method that enables a user to interact with a virtual control panel for controlling an industrial device or system using a user controlled pointing object, the method comprising:
-
receiving data representing a position of the user controlled pointing object, receiving data representing a position of a portable identification element carried and manipulated by the user, storing at least one pre-defined graphical interface representing a control panel of the industrial device or system, generating a graphical representation of the control panel of the device based on said pre-defined graphical interface, registering said graphical representation of the control panel in a fixed relation to said portable identification element, based on said data representing the position of the identification element, to produce the virtual control panel in a position and orientation defined by the user with the portable identification unit, displaying a view comprising the real world and the virtual control panel projected in a fixed relation to said portable identification element, and performing actions to communicate with the industrial device or system to control the industrial device or system in response to the interactions of the user with the virtual control panel, wherein the actions to control the industrial device or system to be performed is determined based on the position of said user controlled pointing object in relation to the position of the virtual control panel. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21, 22)
-
-
23. A computer program product, comprising:
-
a non-transitory computer readable medium; and program instructions recorded on the computer readable medium which, when loaded into a computer, causes the computer to perform a method that enables a user to interact with a virtual control panel for controlling an industrial device or system using a user controlled pointing object, the method comprising receiving data representing a position of the user controlled pointing object, receiving data representing a position of a portable identification element carried and manipulated by the user, storing at least one pre-defined graphical interface representing a control panel of the industrial device or system, generating a graphical representation of the control panel of the device based on said pre-defined graphical interface, registering said graphical representation of the control panel in a fixed relation to said portable identification element, based on said data representing the position of the identification element, to produce the virtual control panel in a position and orientation defined by the user with the portable identification unit, displaying a view comprising the real world and the virtual control panel projected in a fixed relation to said portable identification element, and performing actions to communicate with the industrial device or system to control the industrial device or system in response to the interactions of the user with the virtual control panel, wherein the actions to control the industrial device or system to be performed is determined based on the position of said user controlled pointing object in relation to the position of the virtual control panel.
-
Specification