Three-dimensional input device with displayed legend and shape-changing cursor

• US 5,801,704 A
• Filed: 08/15/1995
• Issued: 09/01/1998
• Est. Priority Date: 08/22/1994
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Yoshida, Kazushi, Sasaki, Naoki, Nemoto, Yasuhiro, Oohara, Shunichi, Matsumoto, Shogo, Sato, Ryoko, Ohtsuka, Hidefumi, Ejiri, Masakazu
• Primary Examiner(s): Breene, John E.
• Application Number:
  US08/515,450
• Time in Patent Office: 1,113 Days
• Field of Search: 395/154-161, 395/326-358, 395/119-127, 395/133, 395/136-139, 395/753, 345/156-158, 345/123-125, 345/121, 345/126, 345/145-146, 340/407.1, 340/407.2, 340/815.4, 463/4, 382/168, 600/146
• US Class Current: 715/856
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects

Abstract

In an image processing apparatus for performing image processing of a processed object by displaying the processed object and an operating cursor on an image display device, and by operating the operating cursor according to three-dimensional actions of the hand and the fingers of an operator, a processing function and a shape of the operating cursor are changed by judging the meaning of the three-dimensional actions of the hand and the fingers to support understanding of the processing function.

Claims

1. An image processing apparatus comprising:

image displaying means for displaying an image;

three-dimensional action detecting means for detecting actions and three-dimensional positions of a hand and fingers of an operator;

cursor generating means for generating operating cursor image data based on a detected result of said three-dimensional action detecting means;

processed object generating means for generating image data of a processed object to be operated upon by an operating cursor displayed based on said operating cursor image data;

display image generating means for synthetically displaying said operating cursor image data and said processed object image data on said image display means;

an image memory for storing image data indicative of a plurality of shaves of the operating cursor corresponding to a plurality of processing functions of said image processing apparatus, each of said Plurality of shapes visually symbolizing a respective one of said plurality of functions;

meaning judging means for judging a meaning of an instruction from a form of action of the hand and fingers detected by said three-dimensional action detecting means;

control changing means for changing a processing function of the image processing apparatus corresponding to a judged result of said meaning judging means;

cursor changing means for changing a shape of the operating cursor corresponding to the processing function of the image processing apparatus as changed by said control changing means, said cursor changing means changing said shape by referring to said image data in said image memory; and

legend image generating means for generating function selecting legend image data which displays image processing function and an operating cursor corresponding to said image processing function.

2. An image processing apparatus according to claim 1, wherein said function selecting legend image data includes an instruction action form for selecting a specified image processing function.

3. An image processing apparatus according to claim 2, wherein said legend image generating means generates function selecting legend image data of the processing function approximated by the instruction action form.

4. An image processing apparatus according to claim 1, which comprises legend image generating means for generating operating legend image data which displays a cursor operation and the image processing corresponding to said cursor operation.

5. An image processing apparatus according to claim 4, which further comprises position judging means for judging presence or absence of contact between the processed object and the operating cursor, and said legend image generating means generates operating legend image data based on the result of the judgement of contact.

6. An image processing apparatus comprising image displaying means for displaying an image, three-dimensional action detecting means for detecting actions and three-dimensional positions of the hand and the fingers of an operator, cursor generating means for generating operating cursor image data based on the detected result of said three-dimensional action detecting means, processed object generating means for generating image data of a processed object to be operated by an operating cursor displayed based on said operating cursor image data, and display image generating means for synthetically displaying said operating cursor image data and said processed object image data on said image display means, which comprises:

meaning judging means for judging the meaning of an instruction from the form of action of the hand and the fingers detected by said three-dimensional action detecting means;

an image memory for storing image data of shape which is shape of operating cursor corresponding to each of processing functions of said image processing means and visually symbolizes each of said functions;

control changing means for changing the processing function of the image processing apparatus corresponding to the judged result of said meaning judging means;

cursor changing means for changing the shape of the operating cursor corresponding to the processing function of said image processing means referring to said image data in said image memory;

legend displaying means for displaying the processing function and plural kinds of operating cursors corresponding to the result of the judgement of said meaning judging means;

condition setting means for setting a processing operating condition corresponding to each of said operating cursor; and

said processed object generating means generating image data of the processed object corresponding to said processing operating condition.

7. A method of image processing in which image processing of a processed object is performed by displaying said processed object and an operating cursor on image display means and by operating said operating cursor corresponding to a three-dimensional action of a hand and fingers of an operator. said method comprising steps of:

storing image data indicative of a plurality of shapes of the operating cursor corresponding to a plurality of processing functions, each of said plurality of shapes visually symbolizing a respective one of said plurality of processing functions;

judging a meaning of an instruction from a form of action of the hand and fingers detected by a three-dimensional action detecting means;

changing a processing function of the image processing apparatus corresponding to a judged result of said judging step; and

changing a shape of the operating cursor corresponding to the processing function as changed by said processing function changing step, said shape being changed by referring to said image data; and

displaying a function selecting legend image expressing an image processing function and an operating cursor corresponding to said image processing function.

8. A method of image processing according to claim 7, further comprising a step of:

displaying an operating legend image expressing a cursor operation and an image processing function corresponding to said cursor operation.