System for storage and navigation of application states and interactions

• US 20070179646A1
• Filed: 04/21/2006
• Published: 08/02/2007
• Est. Priority Date: 01/31/2006
• Status: Active Grant

• Current Assignee: Accenture Global Services Limited (Accenture PLC)
• Original Assignee: Accenture Global Services GmbH (Accenture PLC)
• Inventors: Dempski, Kelly, Harvey, Brandon
• Granted Patent: US 8,209,620 B2
• Time in Patent Office: Days
• US Class Current: 700/83
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 8/20 Software design
• CPC Class Codes: G06F 8/65 Updates security arrangements therefor G06F21/57
• CPC Class Codes: G06Q 10/10 Office automation; Time management

Abstract

Complex collaboration or decision support applications perform complex design or planning tasks, often with the input of large groups of people over long periods of time. The combination of time and complexity can often obscure past actions, making it difficult to remember the factors that influenced earlier stages in the planning task. This is especially true if the task involves many people and different people work at different times. The application state navigation system provides an application-independent mechanism that allows operators to walk back through the history of the application in order to better understand (or remember) the application actions that were taken in the past and the triggers for those actions.

Claims

1. An application state navigation system for historical navigation of an application, the system comprising:

multiple output devices arranged to produce a respective output portion of a system output, each respective output portion being defined by a designated portion of an overall image;

multiple application processors, each application processor configured to process one or more respective application programs, each application processor responsive to the designated portion and coupled with an associated respective output device for controlling the associated respective output device in producing the respective output portion;

a state server in data communication with the plurality of application processors to provide the designated portion of the overall image to the application processors;

an application history repository comprising a historical state database; and

a navigation interface system coupled to the application history repository and the state server, the navigation interface system comprising a memory storing an interface input program operable to obtain a temporal selection, a temporal index program operable to obtain retrieved application state data corresponding to the temporal selection from the application history repository, and an output program operable to provide the application state data to the state server for rendering an application representation of an application state corresponding to the temporal selection on the multiple output devices.

2. The navigation system of claim 1, where the historical state database comprises application state data defining an application state of the application at a predetermined state time, and an application state timestamp representing the predetermined state time.

3. The navigation system of claim 1, where the application history repository further comprises a historical action database comprising action records for multiple operators, the action records comprising application action data defining an action taken on the application at a predetermined action time, an operator identifier which identifies an operator responsible for the action taken, and an application action timestamp representing the predetermined action time, and where:

the temporal index program is further operable to obtain retrieved application action data from the historical action database; and

the output program is further operable to provide the retrieved application action data to the state server with the application state data.

4. The navigation system of claim 1, where the application history repository further comprises a historical environment database comprising environment data defining an environment state of the application at a predetermined environment state time, and an application environment timestamp representing the predetermined environment state time, and where:

the temporal index program is further operable to obtain retrieved environment data from the historical environment database; and

the output program is further operable to provide the retrieved environment data to the state server with the application state data.

5. The application state navigation system of claim 3, where the retrieved application state data corresponds to an application state time other than the temporal selection, and where the retrieved application action data defines application actions taken between the application state time and the temporal selection.

6. The application state navigation system of claim 4, where the retrieved environment data comprises audio information, video information, or both, captured locally with respect to the output devices during development of the application.

7. The application state navigation system of claim 6 further comprising:

input detectors positioned to detect an operator activation and produce an operator activation signal in response thereto; and

an input processor in data communication with the input detectors and the state server to convey information about the operator activation signal for processing by the state server.

8. The application state navigation system of claim 7, where the retrieved environment data comprises audio information, video information, or both, captured remotely with respect to the output devices during development of the application.

9. The system of claim 1, where the display comprises a planar surface, and further comprising:

at least two cameras positioned relative to the planar surface to acquire images of multiple simultaneous targets on the planar surface; and

where the memory further comprises logic for receiving data indicative of images of the multiple simultaneous targets, determining potential positions using triangulation, the potential positions comprising positions for the multiple simultaneous targets and positions for targets not associated with a touch on the planar surface, and analyzing the potential positions to determine which, of the potential positions, comprise the positions for the multiple simultaneous targets.

10. The system of claim 9, wherein a target is registered as an occlusion in the image acquired by the cameras;

and

wherein the logic for determining the potential positions using triangulation comprises logic for selecting one of the at least two cameras and iterating the following logic for each occlusion for the selected camera;

determining a ray corresponding to the occlusion for the selected camera;

determining rays corresponding to the occlusions for an unselected camera; and

triangulating the ray corresponding to the occlusion for the selected camera and the rays corresponding to the occlusions for the unselected camera to determine the potential positions.

11. An application navigation system comprising:

a memory comprising;

an interface input program operable to obtain a temporal selection;

a temporal index program operable to obtain retrieved application state data filtered according to a user profile and corresponding to the temporal selection from an application history repository; and

an output program operable to provide the application state data to an information processing system for rendering an application representation of an application state corresponding to the temporal selection on an output device; and

a processor coupled to the memory which executes the interface input program, the output program, and the temporal index program.

12. The application navigation system of claim 11, where the temporal index program is further operable to obtain retrieved application action data from the application history repository;

and the output program is further operable to provide the retrieved application action data to the information processing system with the application state data.

13. The application navigation system of claim 12, where the retrieved application action data is filtered according to the user profile.

14. The application navigation system of claim 11, where the temporal index program is further operable to obtain retrieved environment data from the application history repository;

and the output program is further operable to provide the retrieved environment data to the information processing system with the application state data.

15. The application navigation system of claim 14, where the retrieved environment data is filtered according to the user profile.

16. The application navigation system according to claim 11, further comprising:

multiple output devices arranged to produce a respective output portion of a system output, each respective output portion being defined by a designated portion of an overall image;

multiple application processors, each application processor configured to process one or more respective application programs, each application processor responsive to the designated portion and coupled with an associated respective output device for controlling the associated respective output device in producing the respective output portion; and

where;

the information processing system comprises a state server in data communication with the plurality of application processors to provide the designated portion of the overall image to the application processors, the state server receiving the application state data for rendering the application representation of the application state corresponding to the temporal selection on the multiple output devices.

17. A method for application navigation, the method comprising:

providing multiple output devices to produce respective output portions of a system output, each respective output portion being defined by a designated portion of an overall image;

configuring multiple application processors to process one or more respective application programs, each application processor responsive to the designated portion and coupled with an associated respective output device for controlling the associated respective output device in producing the respective output portion;

communicating between a state server and the plurality of application processors to provide the designated portion of the overall image to the application processors;

establishing an application history repository comprising a historical state database;

obtaining a temporal selection;

obtaining retrieved application state data corresponding to the temporal selection from the application history repository;

providing the application state data to the state server for rendering an application representation of an application state corresponding to the temporal selection on the multiple output devices.

18. The method of claim 17, where establishing comprises:

establishing application state data defining an application state of the application at a predetermined state time, and an application state timestamp representing the predetermined state time in the application history repository.

19. The method of claim 17, where establishing comprises:

establishing a historical action database comprising action records for multiple operators, the action records comprising application action data defining an action taken on the application at a predetermined action time, an operator identifier which identifies an operator responsible for the action taken, and an application action timestamp representing the predetermined action time, and further comprising;

obtaining retrieved application action data from the historical action database; and

providing the retrieved application action data to the state server with the application state data.

20. The method of claim 17, where establishing comprises:

establishing a historical environment database comprising environment data defining an environment state of the application at a predetermined environment state time, and an application environment timestamp representing the predetermined environment state time, and further comprising;

obtaining retrieved environment data from the historical environment database; and

providing the retrieved environment data to the state server with the application state data.

21. The method of claim 19, where obtaining retrieved application state data comprises:

obtaining the retrieved application state data corresponding to an application state time other than the temporal selection, and where obtaining retrieved application action data comprises;

obtaining retrieved application action data which defines application actions taken between the application state time and the temporal selection.

22. The method of claim 20, where obtaining retrieved environment data comprises:

obtaining audio captured locally with respect to the output devices during development of the application.

23. The method of claim 20, where obtaining retrieved environment data comprises:

obtaining video captured locally with respect to the output devices during development of the application.