Interactive method and system for producing address-correlated information using user-specified address zones

• US 5,592,607 A
• Filed: 10/15/1993
• Issued: 01/07/1997
• Est. Priority Date: 10/15/1993
• Status: Expired due to Term

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Poon, Alex D., Weber, Karon A., Moran, Thomas P.
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): HO, RUAY L
• Application Number:
  US08/138,545
• Time in Patent Office: 1,180 Days
• Field of Search: 395/161, 395/500, 395/100, 395/132, 395/151, 364/413.29, 364/926.1, 382/13, 382/43, 360/22, 358/461
• US Class Current: 715/863
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/1444 Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields

Abstract

An interactive method and system to support and facilitate note-taking tasks in a variety of settings, primarily, though not exclusively, in real time. In one embodiment, the system user uses a stylus device and display to enter notes in the form of handwritten strokes that are stored and correlated with an address, such as a time provided by a system clock. Notes are collected in a data structure represented by a spatial region on the display called an address, or time, zone that is created when the user enters a gesture requesting an address from the system. All notes entered in a particular time zone region in the display area are stored in a portion of the data structure correlated with the time associated with that time zone region, and, while time zones are created in sequential time order, notes are may be entered in time zones in any sequence and still be correlated with that time zone. An additional feature provides for designating a portion of the user'"'"'s notes as a key word, which can then be associated with other time zones to connect key words with times and notes. The strokes entered and designated as a key word are assigned a unique, system-recognizable identifier. A data structure stores the strokes of the key word, its location in the display area and the times zones it is associated with. A well-designed user interface provides workspaces for creating and using time zones and for easily displaying and using key words.

Claims

1. A method of operating a system to capture user-produced event data in a data structure in a manner enabling later retrieval of the user-produced event data;

the system including input circuitry connected to a user input device for producing signals indicating actions of a system user;

output circuitry connected to a display having a display area for presenting images;

a processor connected for receiving the signals from the input circuitry, and connected for providing images to the output circuitry for presentation in the display area of the display; and

memory for storing data;

the data stored in the memory including instruction data indicating instructions the processor executes;

the processor being further connected for accessing the data stored in the memory;

the method comprising;

operating the processor to receive a first signal from the user input device indicating a request from the system user to obtain a user-requested address value from an address source connected for providing address data to the processor of the system;

the address source indicating data measuring an event;

operating the processor to respond to the request from the system user by accessing the address source and obtaining an address data item for use as the user-requested address value;

presenting a first image in the display area;

the first image including an address zone display feature positioned at an address marking location in the display area so that the address zone display feature is perceived by the system user as marking a spatial region in the display area; and

producing an address zone data structure in the memory of the system and storing the address data item and the address marking location therein such that the address zone data structure is accessible by the processor using either the address marking location indicating the spatial region marked in the display area or the address data item indicating the user-requested address value;

operating the processor to receive a second signal from the user input device indicating user-produced event data indicating information entered by the system user in a spatial region in the display area; and

operating the processor to respond to the second signal from the system user by

storing the user-produced event data in the address zone data structure represented by the spatial region in which the user-produced event data was entered such that all of the user-produced event data entered by the system user within the spatial region marked in the display area is accessible by the processor in the address zone data structure using the user-requested address value indicated by the address data item obtained when the spatial region was first produced; and

presenting a second image in the spatial region of the display area;

the second image including display features representing the user-produced event data entered by the user.

2. The method of claim 1 wherein the address source is a clock source connected for providing time data to the processor of the system.

3. The method of claim 1 wherein the step of storing the user-produced event data in the address zone data structure includes storing image definition data defining the display features representing the user-produced event data entered by the system user and included in the second image.

4. The method of claim 1 wherein the first signal received from the user is received from a stroke inputting device connected for interacting with the display to produce a first stroke as the signals indicating the actions of the system user.

5. The method of claim 4 wherein the first stroke is a horizontal stroke.

6. The method of claim 1 wherein the second signal received from the user is received from a stroke inputting device connected for interacting with the display to produce a stroke as the signals indicating the actions of the system user;

the user-produced event data being a stroke entered on the surface of the display by the system user using the stroke inputting device.

7. The method of claim 6 wherein the step of storing the user-produced event data in the address zone data structure includes storing signals indicating the stroke entered on the surface of the display by the system user using the stroke inputting device.

8. The method of claim 1 wherein the user input device for providing the signals indicating the actions of the system user is a stylus device connected for interacting with the display to produce the signals in the form of a handwritten stroke.

9. The method of claim 1 further including

operating the processor to receive a third signal from the user input device indicating a data designation action by the system user designating a portion of the user-produced event data for use as an information designator;

the portion hereafter referred to as the information designator;

the third signal indicating the system user'"'"'s action of creating an information designator; and

operating the processor to respond to the third signal from the system user by

presenting in the display area a third image including a designator display object positioned in a designator location in the display area;

the designator display object including display features representing the information designator designated by the system user; and

producing an information designator data structure and storing therein the information designator and the designator location of the designator display object in the third image the designator location indicating the information designator such that the information designator data structure is accessible by the processor when the system user subsequently selects the designator display object in the display area;

the system user having the capability of designating any user-produced event data entered in a spatial region as an information designator.

10. The method of claim 9 wherein the third image is presented in the spatial region;

the designator location of the display object in the third image being a location in the spatial region.

11. The method of claim 9 wherein the third image is presented in an information designator region of the display area distinct from the spatial region;

the designator location of the display object in the third image being a location in the information designator region.

12. The method of claim 9 further including

operating the processor to receive a fourth signal from the user input device indicating a selection action by the system user selecting the designator display object included in the third image as a selected information designator;

the selection action including the designator location of the designator display object in the display area;

the fourth signal further including a designator target action indicating a target spatial region in the display area;

the fourth signal indicating the system user'"'"'s action of associating a selected information designator with a target spatial region; and

operating the processor to respond to the fourth signal from the system user by

modifying the information designator data structure represented by the selected information designator to include data indicating the target spatial region such that all target spatial regions and the user-requested address values associated therewith are accessible by the processor and retrievable by the system user using the selected information designator; and

presenting a fourth image in the target spatial region in the display area;

the fourth image including display features representing the selected information designator.

13. The method of claim 12 wherein

the user input device for providing the signals indicating the actions of the system user is a stroke inputting device connected for interacting with the display to produce the signals in the form of a stroke;

the designator target action indicating the target spatial region location of the target spatial region in the display area is a substantially vertical stroke entered on the surface of the display;

the target spatial region location being in an information designation region included in the target spatial region;

the information designation region being included in the first image; and

the fourth image includes display features representing the substantially vertical stroke;

the fourth image being presented in the information designation region included in the target spatial region.

14. The method of claim 9 wherein operating the processor to respond to the third signal further includes

assigning a unique information designator identifier to the information designator;

and

storing the information designator in the information designator data structure further includes storing the unique information designator identifier therein such that a selected information designator may be retrieved from an information designator data structure using the designator location thereof or using the unique information designator identifier thereof;

and wherein

the designator display object included in the third image further includes display features representing the unique information designator identifier positioned in the third image relative to the display features representing the information designator so that the unique information designator identifier is perceived by the system user as being associated with the information designator; and

when the system user selects the unique information designator identifier assigned to the information designator, the unique information designator identifier is used to access the information designator data structure.

15. The method of claim 14 further including

operating the processor to receive a fourth signal from the user input device indicating a selection action by the system user selecting the designator display object included in the third image as a selected information designator;

the selection action including the designator location of the designator display object in the display area;

the fourth signal further including a designator target action indicating a target spatial region location of a target spatial region in the display area;

the fourth signal indicating the system user'"'"'s action of associating a selected information designator with a target spatial region; and

operating the processor to respond to the fourth signal from the system user-by

modifying the information designator data structure represented by the selected information designator to include data indicating the target spatial region such that all target spatial regions and the user-requested address values associated therewith are accessible by the processor and retrievable by the system user using the selected information designator; and

presenting a fourth image including display features representing the unique information designator identifier in the display area.

16. The method of claim 9 wherein

the user input device for providing the signals indicating the actions of the system user is a stroke inputting device connected for interacting with the display to produce the signals in the form of a stroke;

the third signal from the stroke inputting device indicating the data designation action is an enclosure stroke entered on the surface of the display substantially enclosing the information designator; and

the designator display object included in the third image further includes display features representing the enclosure stroke substantially enclosing the information designator in the third image.

17. The method of claim 1 wherein the event measured by the address source is an event occurring in real time and being observed by the system user;

wherein the user-produced event data entered by the system user indicates information about the event being observed by the system user;

wherein the user-requested address value is a user-requested time value indicating a real clock time; and

wherein all of the user-produced event data entered into the first spatial region in the display area at any time during user observation of the event is stored in the address zone data structure represented by the first spatial region;

all of the user-produced event data thereby being indexed by and accessible to the processor using the user-requested time value.

18. The method of claim 9 wherein the step of modifying the address zone data structure includes

obtaining the address zone data structure of the target spatial region using a target spatial region location indicated by the fourth signal;

obtaining the selected information designator using the designator location of the selected information designator; and

storing the selected information designator in the address zone data structure such that the selected information designator indicates the address data item of the address zone data structure;

the user-produced event data included in the address zone data structure of the target spatial region being accessible to the processor using the selected information designator and the address data item.

19. A method of operating a system to capture user-produced event data in a data structure in a manner enabling later retrieval of the user-produced event data;

the system including input circuitry connected to a user input device for producing signals indicating actions of a system user;

output circuitry connected to a display having a display area for presenting images;

a processor connected for receiving the signals from the input circuitry, and connected for providing images to the output circuitry for presentation in the display area; and

memory for storing data;

the data stored in the memory including instruction data indicating instructions the processor executes;

the processor being further connected for accessing the data stored in the memory;

the method comprising;

operating the processor to present a first image in the display area of the display;

the first image including display features representing a first display region, hereafter referred to as a first workspace for use in inputting user-produced event data;

operating the processor to receive a first signal from the user input device indicating a first image display request from the system user to display a first one of a plurality of spatial regions in the first workspace and to associate the first spatial region with a unique user-requested address value;

the unique user-requested address value being obtained from an address source connected for providing address data to the system processor;

the address source measuring an event being perceived by the system user;

operating the processor to respond to the first image display request from the system user by presenting a second image in the first workspace in the display area;

the second image including an address zone display feature positioned in the first workspace at an address display location marking the first spatial region in the first workspace;

the address display location marking the first spatial region being associated with the unique user-requested address value in an address zone data structure produced in response to the first image display request and stored in the memory;

operating the processor to receive a second signal from the user input device indicating a second image display request including user-produced event data entered by the system user indicating information about the event being perceived by the system user;

the second signal further including a spatial region location in the first workspace indicating a location of the user-produced event data in the first spatial region; and

operating the processor to respond to the second image display request from the system user by presenting a third image in the first workspace in the first spatial region including the spatial region location;

the third image including display features representing the user-produced event data entered by the system user;

the user-produced event data indicating information about the event being perceived and entered by the system user into the first spatial region being stored in the address zone data structure indicating the address display location marking the first spatial region such that the user-produced event data is accessible by the processor using the unique user-requested address value;

user-produced event data subsequently entered by the system user into the first spatial region also being stored in the address zone data structure indicated by the address display location marking the first spatial region such that all of the user-produced event data entered by the system user into the first spatial region is indexed by and accessible to the processor using the user-requested address value.

20. The method of claim 19 wherein the event being observed by the user is occurring in real time;

wherein the address source is a clock source connected for providing time data to the processor of the system; and

wherein the user-requested address value is a user-requested time value indicating a real clock time.

21. The method of claim 19 wherein

the address display location in the first workspace defines a first starting location of the first spatial region associated with the unique user-requested address value;

an ending location of the first spatial region being defined by a second address display location indicating a second starting location in the first workspace of a second one of the plurality of spatial regions; and

the user-produced event data is stored in the address zone data structure indicating the address display location marking the first spatial region when the spatial region location of the user-produced event data is any display location equal to or greater than the first starting location of the first spatial region and less than the ending location of the second spatial region.

22. The method of claim 19 wherein the first image further includes a second workspace for presenting display features representing information designators;

and wherein the method further includes

operating the processor to receive a third signal from the user input device indicating a third image display request including a data designation action by the system user designating the display features representing a portion of the user-produced event data in the third image as an information designator;

the portion being hereafter referred to as the information designator;

the third signal indicating the system user'"'"'s action of creating an information designator; and

operating the processor to respond to the third image display request from the system user by

presenting a fourth image in the second workspace;

the fourth image including a designator display object including display features representing the information designator positioned in a designator location in the second workspace; and

producing an information designator data structure and storing therein the the information designator and the designator location of the designator display object in the fourth image;

the designator location indicating the information designator such that the information designator data structure is accessible by the processor when the system user subsequently selects the designator display object in the display area;

the system user having the capability of designating any user-produced event data entered in a spatial region as an information designator.

23. The method of claim 22 further including

operating the processor to receive a fourth signal from the user input device indicating a fourth image display request including a selection action by the system user selecting the designator display object included in the second workspace as a selected designator display object representing a selected information designator;

the selection action including the designator location of the selected designator display object in the second workspace;

the fourth image display request further including a target spatial region location in the first workspace;

the fourth signal indicating the system user'"'"'s action of associating a selected information designator with a target spatial region; and

operating the processor to respond to the fourth signal from the system user by

presenting a fifth image in the first workspace;

the fifth image including display features representing the selected information designator;

the fifth image being presented in the spatial region in the first workspace including the target spatial region location; and

modifying the information designator data structure represented by the selected information designator to include data indicating the target spatial region such that all target spatial regions and the unique user-requested address values associated therewith are accessible by the processor and retrievable by the system user using the selected information designator.

24. The method of claim 23 wherein the first image further includes a third workspace for presenting display features representing data retrieval information;

and wherein the method further includes

operating the processor to receive a fifth signal from the user input device indicating a fifth image display request including a data retrieval action by the system user;

the fifth signal including a selection action by the system user selecting the designator display object included in the second workspace as a selected designator display object representing a selected information designator;

the fifth signal further including the designator location of the selected information designator; and

operating the processor to respond to the fifth image display request from the system user by

obtaining the address zone data structure representing each one of the plural spatial regions in the first workspace having the selected information designator associated therewith; and

presenting a sixth image in the third workspace;

the sixth image including display features representing the unique user-requested address value included in the address zone data structure representing each one of the plural spatial regions in the first workspace the selected information designator associated therewith.

25. The method of claim 19 wherein the user input device for providing the signals indicating the actions of the system user is a stylus device connected for interacting with the display to produce the signals in the form of a handwritten stroke;

the user-produced event data being a stroke entered on the surface of the display by the system user using the stylus device; and

the step of storing the user-produced event data in the address zone data structure includes storing signals indicating the handwritten stroke.

26. An interactive, processor-controlled system for storing in a data structure for later retrieval time-stamped, handwritten information entered by a system user;

the system including

a stroke-producing input device for producing signals in the form of strokes indicating actions of a system user;

a display having a display area for presenting images;

a processor connected for receiving the signals from the input device, and connected for providing images to the display;

a clock source connected for providing time data to the processor; and

memory for storing data;

the data stored in the memory including instruction data indicating instructions the processor executes;

the processor being further connected for accessing the data stored in the memory;

the processor, in executing the instructions, presenting a first image in the display area of the display;

the first image including display features representing plural spatial regions for presenting user-produced event data;

the processor, further in executing the instructions, responding to a time request stroke received from the system user by obtaining a unique user-requested time value from the clock source and presenting a second image in a first one of the plural spatial regions in the display area;

the second image including a time zone display feature positioned in the first one of the plural spatial regions at a time display location;

the time zone display feature representing the unique user-requested time value obtained from the clock source;

the processor, further in responding to the time request stroke, storing the unique user-requested time value and the time display location of the first spatial region in a time zone data structure represented by the first spatial region such that the time zone data structure is accessible to the processor using either the time display location or the unique user-requested time value; and

the processor, further in executing the instructions, responding to information strokes indicating user-produced data received from the system user and entered in the first spatial region by presenting a third image in the first spatial region;

the third image including display features representing the user-produced data;

the processor, further in responding to the information strokes, storing the user-produced data in a time zone data structure represented by the first spatial region;

the user-produced data being stored in the time zone data structure such that all user-produced event data entered into the first spatial region is accessible to the processor using the unique user-requested time value obtained when the time zone data structure was first produced.

27. The interactive processor-controlled system of claim 26 wherein the user-produced data stored in the time zone data structure is image data indicating the display features representing the user-produced data in the third image.

28. The interactive processor-controlled system of claim 26 wherein

the processor, further in executing the instructions, receives a data designation stroke and a target stroke from the system user;

the data designation stroke designating display features representing a portion of the user-produced data in the third image as an information designator;

the portion of the user-produced data in the third image having a location in the third image referred to as a designator location;

the target stroke indicating a target location in one of the plural spatial regions, referred to as a target spatial region;

the data designation and target strokes indicating an action of the system user creating an information designator and associating the information designator with the target spatial region;

the processor, further in executing the instructions, responds to the data designation and target strokes by producing an information designator data structure and storing therein the information designator, the designator location and the target location such that a target zone data structure represented by the target spatial region and the user-requested time value stored therein is accessible to the processor using the designator location of the information designator;

the system user being able to retrieve all user-requested time values having the information designator associated therewith.