Voice assisted visual search
First Claim
1. A method for assisting a user of a computer system, comprised of at least one electronic display, a user voice input device, and a computer processor with a memory storage, in viewing a plurality of visual objects, the method comprising the method steps ofcreating in computer memory a representation of a plurality of visual objects;
- anddisplaying said plurality of visual objects to the user; and
detecting and processing a voice input from a user; and
establishing, whether an information in the voice input matches one or several representations of visual objects comprising said plurality of visual objects; and
displaying visual artifacts highlighting spatial locations of visual object or visual objects, which match the information in the voice input,whereby highlighting of said matching visual object or visual objects assists the user in carrying our visual search of visual objects of interest.
0 Assignments
0 Petitions
Accused Products
Abstract
The invention discloses a method and apparatus for (a) processing a voice input from the user of computer technology, (b) recognizing potential objects of interest, and (c) using electronic displays to present visual artefacts directing user'"'"'s attention to the spatial locations of the objects of interest. The voice input is matched with attributes of the information objects, which are visually presented to the viewer. If one or several objects match the voice input sufficiently, the system visually marks or highlights the object or objects to help the viewers direct his or her attention to the matching object or objects. The sets of visual objects and their attributes, used in the matching, may be different for different user tasks and types of visually displayed information. If the user views only a portion of a document and user'"'"'s voice input matches an information object, which is contained in the entire document but not displayed in the current portion, the system displays a visual artefact, which indicates the direction and distance to the object.
-
Citations
17 Claims
-
1. A method for assisting a user of a computer system, comprised of at least one electronic display, a user voice input device, and a computer processor with a memory storage, in viewing a plurality of visual objects, the method comprising the method steps of
creating in computer memory a representation of a plurality of visual objects; - and
displaying said plurality of visual objects to the user; and detecting and processing a voice input from a user; and establishing, whether an information in the voice input matches one or several representations of visual objects comprising said plurality of visual objects; and displaying visual artifacts highlighting spatial locations of visual object or visual objects, which match the information in the voice input, whereby highlighting of said matching visual object or visual objects assists the user in carrying our visual search of visual objects of interest. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
- and
-
14. Apparatus, comprising at least an electronic display;
- and
a user voice input device; and a computer processor, and a memory storage, which can be integrated with said computer processor; and means for creating in computer memory a representation of a plurality of visual objects; and means for displaying said plurality of visual objects to the user; and means for detecting and processing a voice input from a user; and means for establishing, whether an information in the voice input matches one or several representations of visual objects comprising said plurality of visual objects; and means for displaying visual artifacts highlighting spatial locations of visual object or visual objects, which match the information in the voice input; whereby highlighting of said matching visual object or visual objects assists the user in carrying our visual search of visual objects of interest. - View Dependent Claims (15, 16, 17)
- and
Specification