Automatic location of screen objects through the use of relational position data

• US 5,379,375 A
• Filed: 02/07/1994
• Issued: 01/03/1995
• Est. Priority Date: 08/27/1991
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Dao, Vinh D., Ostojic, Sasha
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): Breene, John E.
• Application Number:
  US08/192,773
• Time in Patent Office: 330 Days
• Field of Search: 395/155-161, 395/600, 395/800, 395/133-139, 345/121, 345/123, 379/67-68, 379/89, 379/265-266
• US Class Current: 715/862
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: H04M 11/00 Telephonic communication systems specially adapted for combination with other electrical systems
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals

Abstract

A system and method for locating an object on a display screen is described which initially establishes, for display objects on a reference display screen, relative positional offsets of such objects from a benchmark object on the screen. When a new display screen is received and that corresponds to a display screen, the system responds to a command to access a requested object on the new display screen by finding the benchmark object on the new screen and determining the requested object'"'"'s location by reference to preestablished relative position offsets from the found benchmark object.

Claims

1. In a system including a processing unit and a computer that communicates with said processing unit by transmission of display screens, which display screens are stored by said processing unit, a method for enabling said processing unit to determine without user interaction a location of an object in a received, stored display screen, said processing unit performing the method comprising:

a. assigning to a first display object in a stored reference display screen, a relative positional offset from a benchmark object, said first display object and benchmark object moved together upon a scrolling action of said reference display screen, said benchmark object providing a reference from which positions of display objects are determined;

b. receiving a new display screen from said computer that matches said stored reference display screen; and

c. locating a requested display object on said new display screen, said new display object corresponding to said first display object, by finding a location of said benchmark object on said new display screen and determining, without user interaction, a location of said requested display object on said new display screen by reference to said first display object'"'"'s relative positional offset assigned in step (a).

2. The method as recited in claim 1, including a further step that occurs prior to step (a), said further step comprising:

storing data describing plural reference display screens and establishing relative positional offsets for display objects on said reference display screens, both from a benchmark object and as between display objects, and wherein step (b) further compares data describing said new display screen with data describing said stored plurality of reference display screens to find a match with one of said reference display screens.

3. The method as recited in claim 2, wherein, in step (c), relative positional offsets determined from a matching reference display screen enable location of a display object on said new display screen.

4. The method as recited in claim 3 wherein step (c) comprises the further substeps of:

finding a relative positional offset for said requested display object and determining if a benchmark object is referred to by said found relative positional offset and, if not, finding a relative positional offset for the display object referenced by said relative positional offset and determining if a benchmark object is referred to by that found positional offset; and

repeating the aforesaid finding and determining substeps until a benchmark object is found.

5. The method as recited in claim 4 wherein said benchmark object is located by finding a memory location corresponding to the memory location where said benchmark object is stored in said matching reference screen, and if not found at said memory location, searching data stored in memory to find said benchmark object.

6. The method as recited in claim 5 wherein once said benchmark object is located, finding said requested display object by use of intermediate referenced display objects having linked relative positional offsets.

7. A voice inquiry system including a host computer and a voice processing unit (VPU), said host computer including application software and communicating with said VPU by providing display screens produced by said application software, said VPU comprising:

storage means for storing data corresponding to application generated reference display screens received from said host computer and positional offsets of display objects on each of said display screens, certain said positional offsets determined from a benchmark object which is used as a positional reference point on each said display screen;

processor means for responding to a user inquiry requesting a display object, by obtaining data corresponding to a new display screen containing said requested display object from said host computer;

means for searching said storage means to match said data corresponding to said new display screen with data corresponding to a stored reference display screen, a matching reference display screen containing another display object that corresponds to said requested display object; and

means for searching said data corresponding to said new display screen for a benchmark object and determining a position of said requested display object on said new display screen from positional offset data for said another display object, as derived from data corresponding to said matching reference screen stored in said memory means.

8. The voice inquiry system as recited in claim 7, wherein a scroll movement of display objects on a said display screen causes concurrent movement of all display objects on said display screen, including a said benchmark object.

9. The voice inquiry system as recited in claim 8, wherein said storage means stores relative positional offsets of certain display objects from a benchmark object and stores relative positional offsets between display objects and other display objects, said relative positional offsets between display objects stored as a list that is arranged to enable said display objects to be located once said benchmark object is located.