Gesture-modified diagram for retrieval of image resembling diagram, with parts selectable for further interactive retrieval
First Claim
1. An information retrieval system comprising:
- presenting means for providing presentations to a user, the presenting means comprising display means for providing visual presentations to the user;
selection input means for providing signals indicating user selections within visual presentations provided by the display means;
gesture input means for providing data basaed on gestures of the user;
memory for storing a plurality of interactive items, the display means being capable of providing a respective interactive presentation based on each of the interactive items;
the respective interactive presentations of a first one of the interactive items including a first image, the first image including a plurality of parts including a first part;
the memory further being for storing, for each of the parts of the first image, a respective set of related information items based on each of which the presenting means can provide a respective presentation for providing information to the user;
the respective set of related information items of the first part including a first information item;
the first image further including, for each of the parts, a respective selectable bounded area that is selectable by the user with the selection input means in requesting presentations based on information items from the respective set of related information items;
first means for using visual feature data from the gesture input means to determine whether the first image includes features resembling a desired set of visual features and, if so, for causing the display means to provide the first interactive item'"'"'s respective interactive presentation that includes the first image;
the visual feature data being based on a gesture indicating the desired set of visual features;
the visual feature data indicating the gesture'"'"'s path of motion; and
second means for receiving a request signal requesting the first information item'"'"'s respective presentation and for responding to the request signal by causing the presenting means to provide the first information item'"'"'s respective presentation for providing information to the user;
the request signal including a selection signal from the selection input means, the selection signal indicating user selection of the first part'"'"'s respective selectable bounded area.
4 Assignments
0 Petitions
Accused Products
Abstract
Recorded video segments are retrieved and displayed through a user interface that employs gestures. The user provides gestures by moving a mouse, and the resulting signals indicate a diagram. Data identifying the diagram is used to access a data structure to obtain data indicating which of a set of interactive line drawings includes features most closely resembling the diagram. The interactive line drawing with features closest to the diagram can then be displayed. When the user selects a part of the line drawing, a menu is displayed that includes a description of the video segments that relate to that part. To assist the user in providing gestural input, a preliminary diagram is displayed, reducing the amount of information the user must provide. The user can change parts of the diagram to obtain a modified diagram resembling features that appear in a desired line drawing. The diagrams and interactive line drawings can be displayed on a workstation display screen, while the video segments can be displayed on a video monitor screen by a video disk player under control of the workstation CPU.
-
Citations
24 Claims
-
1. An information retrieval system comprising:
-
presenting means for providing presentations to a user, the presenting means comprising display means for providing visual presentations to the user; selection input means for providing signals indicating user selections within visual presentations provided by the display means; gesture input means for providing data basaed on gestures of the user; memory for storing a plurality of interactive items, the display means being capable of providing a respective interactive presentation based on each of the interactive items;
the respective interactive presentations of a first one of the interactive items including a first image, the first image including a plurality of parts including a first part;
the memory further being for storing, for each of the parts of the first image, a respective set of related information items based on each of which the presenting means can provide a respective presentation for providing information to the user;
the respective set of related information items of the first part including a first information item;
the first image further including, for each of the parts, a respective selectable bounded area that is selectable by the user with the selection input means in requesting presentations based on information items from the respective set of related information items;first means for using visual feature data from the gesture input means to determine whether the first image includes features resembling a desired set of visual features and, if so, for causing the display means to provide the first interactive item'"'"'s respective interactive presentation that includes the first image;
the visual feature data being based on a gesture indicating the desired set of visual features;
the visual feature data indicating the gesture'"'"'s path of motion; andsecond means for receiving a request signal requesting the first information item'"'"'s respective presentation and for responding to the request signal by causing the presenting means to provide the first information item'"'"'s respective presentation for providing information to the user;
the request signal including a selection signal from the selection input means, the selection signal indicating user selection of the first part'"'"'s respective selectable bounded area. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A system comprising:
-
presenting means for providing presentations to a user, the presenting means comprising display means for providing visual presentations to the user; selection input means for providing signals indicating user selections within visual presentations provided by the display means; gesture input means for providing data based on gestures of the user; memory for storing a plurality of interactive items, the display means being capable of providing a respective interactive presentation based on each of the interactive items;
the respective interactive presentation of a first one of the interactive items including a first image, the first image including a plurality of parts including a first part;
the memory further being for storing, for each of the parts of the first image, a respective set of related information items based on each of which the presenting means can provide a respective presentation;
the respective set of related information items of the first part including a first information item;
the first image further including, for each of the parts, a respective selectable bounded area that is selectable by the user with the selection input means in requesting presentations based on information items from the respective set of related information items;first means for using diagram data from the gesture input means to determine whether the first image resembles a diagram and, if so, for causing the display means to provide the first interactive item'"'"'s respective interactive presentation that includes the first image;
the diagram data being based on a gesture indicating the diagram;
the diagram data indicating the gesture'"'"'path of motion; andsecond means for receiving a request signal requesting the first information item'"'"'s respective presentation and for responding to the request signal by causing the presenting means to provide the first information item'"'"'s respective presentation;
the request signal including a selection signal from the selection input means, the selection signal indicating user selection of the first part'"'"'s respective selectable bounded area. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A method of operating an information retrieval system that includes:
-
presenting means for providing presentations to a user, the presenting means including display means for providing visual presentations to a user; selection input means for providing signals indicating user selections within visual presentations provided by the display means; gesture input means for providing data based on gestures of the user; memory for storing a plurality of interactive items, the display means being capable of providing a respective interactive presentation based on each of the interactive items;
the respective interactive presentations of a first one of the interactive items including a first image, the first image including a plurality of parts including a first part;
the memory further being for storing, for each of the parts of the first image, a respective set of related information items based on each of which the presenting means can provide a respective presentation for providing information to the user;
the respective set of related information items of the first part including a first information item;
the first image further including, for each of the parts, a respective selectable bounded area that is selectable by the user with the selection input means in requesting presentations based on information items from the respective set of related information items;the method comprising steps of;
receiving visual feature data from the gesture input means, the visual feature data being based on a gesture indicating a desired set of visual features, the visual feature data indicating the gesture'"'"'s path of motion;using the visual feature data to determine whether the first image includes features resembling the desired set of visual features and, if so, causing the display means to provide the first interactive item'"'"'s respective interactive presentation that includes the first image; receiving a request signal requesting the first information item'"'"'s respective presentation;
the request signal including a selection signal from the selection input means, the selection signal indicating user selection of the first part'"'"'s respective selectable bounded area; andin response to the request signal, causing the presenting means to provide the first information item'"'"'s respective presentation for providing information to the user. - View Dependent Claims (14, 15, 16)
-
-
17. A method of operating a system that includes:
-
presenting means for providing presentations to a user, the presenting means including display means for providing visual presentations to the user; selection input means for providing signals indicating user selections within visual presentations provided by the display means; gesture input means for providing data based on gestures of the user; memory for storing a plurality of interactive items, the display means being capable of providing a respective interactive presentation based on each of the interactive items;
the respective interactive presentation of a first one of the interactive items including a first image, the first image including a plurality of parts including a first part;
the memory further being for storing, for each of the parts of the first image, a respective set of related information items based on each of which the presenting means can provide a respective presentation;
the respective set of related information items of the first part including a first information item;
the first image further including, for each of the parts, a respective selectable bounded area that is selectable by the user with the selection input mens in requesting presentations based on information items from the respective set of related information items;the method comprising steps of;
receiving diagram data from the gesture input means, the diagram data being based on a gesture indicating a diagram, the diagram data indicating the gesture'"'"'s path of motion;using the diagram data to determine whether the first image resembles the diagram and, if so, causing the display means to provide the first interactive item'"'"'s respective interactive presentation that includes the first image; receiving a request signal requesting the first information item'"'"'s respective presentation;
the request signal including a selection signal from the selection input means, the selection signal indicating user selection of the first part'"'"'s respective selectable bounded area; andin response to the request signal, causing the presenting means to provide the first information item'"'"'s respective presentation. - View Dependent Claims (18, 19)
-
-
20. A method of operating a system that includes:
-
display means for providing visual presentations to a user; memory for storing a plurality of visual items, the display means being capable of providing a respective visual presentation based on each of the visual items;
the visual items including a first visual item; andgesture input means for providing data based on gestures of the user; the method comprising steps of; causing the display means to provide a preliminary diagram presentation that includes a preliminary diagram; receiving diagram change data from the gesture input means, the diagram change data being based on a gesture of the user indicating a change in the preliminary diagram that would produce a modified diagram, the diagram change data indicating the gesture'"'"'s path of motion; and using the diagram change data to determine whether the first visual item'"'"'s respective visual presentation includes an image resembling the modified diagram and, if so, causing the display means to provide the first visual item'"'"'s respective visual presentation. - View Dependent Claims (21, 22, 23, 24)
-
Specification