Information processing system

• US 5,436,639 A
• Filed: 03/15/1994
• Issued: 07/25/1995
• Est. Priority Date: 03/16/1993
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Numata, Tooru, Miura, Masaki, Yokota, Toshimi, Arai, Toshifumi, Shojima, Hiroshi, Fukunaga, Yasushi, Kuzunuki, Soshiro, Sakao, Hideki, Aisaka, Kazuo, Gunji, Keiko
• Primary Examiner(s): BRIER, JEFFERY A
• Application Number:
  US08/213,030
• Time in Patent Office: 497 Days
• Field of Search: 345/1, 345/113-115, 345/156-158, 345/173-178
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041

Abstract

An information processing system which comprises an integral input and display unit comprising a display which enables an object to be selectively displayed at one of a plurality of positions in a display area and a tablet having an input face overlaid on a display face of the display, the input and display face being disposed substantially horizontally, and a display whose display face is disposed substantially uprightly, wherein when an object is presented to a user in the display area of the display, a display position of the object is determined in response to at least one of a state of the user, a state of the input and display face, and a display state of the display, thereby enabling the object to be displayed at an easy-to-use position relative to the user'"'"'s position.

Claims

1. An information processing system which displays an object on a display, comprising:

an integral input and display unit comprising a display which enables an object to be selectively displayed at one of a plurality of positions in a display area and a tablet having an input face overlaid on a display face of said display, the input and display face being disposed substantially horizontally; and

means, when an object is to be presented to a user in the display area of said display, for determining a display position of the object in response to at least one of a state of the user, a state of any article placed on the input and display face, and a display state of said display.

2. The information processing system as claimed in claim 1 wherein said display position determination means has means for detecting a position of the user relative to said integral input and display unit for determining a position near the detected user position as a display position presenting the object.

3. The information processing system as claimed in claim 2 wherein said user position detection means is made up of means for inputting an image of the user and means for processing an image inputted by said input means.

4. The information processing system as claimed in claim 1 wherein said display position determination means has means for detecting an article placed on the input and display face for determining the display position of the object so as to avoid a position of the articles detected by said article detection means.

5. The information processing system as claimed in claim 4 wherein said article detection means has

means for inputting the input and display face;

means for processing an image inputted by said input means; and

display control means for temporarily stopping display of the object at a time when an image is inputted by said input means.

6. The information processing system as claimed in claim 1 wherein said display position determination means has means for storing display position information of an object displayed on the input and display face for determining the display position of that object so as to avoid the display position of the object stored in said position information storage means.

7. The information processing system as claimed in claim 1 wherein said display position determination means provides a plurality of decision conditions concerning the state of the user, the state of any article placed on the input and display face, and the display state of said display, assigns priority levels to said plurality of decision conditions and combinations thereof, and finds a position at which the object is to be displayed in sequence according to the priority levels.

8. The information processing system as claimed in claim 1 further comprising:

an additional display device whose display screen is upright with respect to said integral input and display unit; and

pen detection means for determining whether or not the user picks up a pen of said tablet,

wherein said display position determination means displays the object on said integral input and display unit if it is recognized that the user picks up the pen based on a determination result of said pen detection means.

9. The information processing system as claimed in claim 1 further comprising:

an additional display device whose display screen is upright with respect to said integral input and display unit; and

keyboard position detection means for detecting a relative position between the user and a keyboard,

wherein said display position determination means displays the object on said additional display device if it is recognized that the keyboard is placed in front of the user based on a detection result of said keyboard detection means.

10. An information processing system which displays an object on a display, comprising:

an integral input and display unit comprising a display and a tablet having an input face overlaid on a display face of said display, the input and display face being disposed substantially horizontally;

an additional display device whose display screen is upright with respect to said integral input and display unit;

pen detection means for detecting the user picking up a pen of said tablet; and

display position determination means, when an object is to be presented to the user, for displaying the object on said integral input and display unit if it is recognized that the user picks up the pen based on a detection result of said pen detection means.

11. An information processing system which displays an object on a display, comprising:

an integral input and display unit comprising a display and a tablet having an input face overlaid on a display face of said display, the input and display face being disposed substantially horizontally;

an additional display device whose display screen is upright with respect to said integral input and display unit;

keyboard position detection means for detecting a relative position between the user and a keyboard; and

display position determination means, when an object is to be presented to the user, for displaying the object on said additional display device if it is recognized that the keyboard is placed in front of the user based on a detection result of said keyboard detection means.

12. In an integral input and display unit comprising a display which enables an object to be selectively displayed at one of a plurality of positions in a display area and a tablet having an input face overlaid on a display face of said display, the input and display face being disposed substantially horizontally, a method of detecting an article placed on the display face when said display is used, said method comprising the steps of:

temporarily stopping display of the object on said display when the display face top is inputted by an input device; and

detecting the article placed on the display face based on an image inputted at a time when the object display is stopped.

13. An information processing system which displays an object on a display comprising:

a display;

a camera for taking a picture on a display face of said display; and

a processor connected to said display and said camera, said processor comprising;

means for displaying a document represented by document data to be processed on said display;

means for recognizing a hand of an operator and a position and motion of the hand contained in the picture taken by said camera;

means responsive to the recognized hand position for determining whether or not the operator hand is placed on a display position of the document on the display face of said display; and

display operation means, if the operator hand is placed on the display position of the document, responsive to motion of the operator hand subsequently recognized for performing corresponding operation on the document on which the hand is placed.

14. The information processing system as claimed in claim 13 further comprising:

means, if the operator hand is placed on the display position of the document, responsive to the recognized hand and hand position for determining whether the operator places one hand or both hands on the display position of the document,

wherein if the operator hand is placed on the display position of the document, said display operation means is responsive to motion of the operator hand subsequently recognized and a determination as to whether the operator places one hand or both hands on the display position of the document for performing different operation on the display of the document on which the hand or hands are placed.

15. The information processing system as claimed in claim 14 further comprising:

a tablet being laminated on the display face of said display for accepting coordinates entered by the operator,

said processor further including;

means, if the coordinates accepted by said tablet are a position corresponding to the display position of the document, responsive to a locus of the coordinates accepted by said tablet for recognizing the type of character or graphics drawn by the operator; and

means for entering the character or graphics of the type recognized in the document displayed at the display position corresponding to the coordinates accepted by said tablet and updating the display of the document to display of the document in which the character or graphics of the type recognized is entered.

16. The information processing system as claimed in claim 13, wherein

said document data provides a document having a plurality of pages;

and

said display operation means of said processor, if the operator places both hands on the display position of the document, is responsive to motion of the operator hands subsequently recognized for performing operation concerning display of pages of the document and, if the operator places one hand on the display position of the document, is responsive to motion of the operator hand subsequently recognized for performing operation on display of the entire document.

17. The information processing system as claimed in claim 13, wherein the processor further includes means for outputting sound effects defined according to the operation performed by said display operation means on display.

18. An information processing system which displays an object on a display, comprising:

a display;

a camera for taking a picture on a display face of said display; and

a processor connected to said display and said camera, said processor including;

means for displaying a document containing a plurality of pages represented by document data to be processed on said display;

means for recognizing a hand of an operator and a position and motion of the hand contained in the picture taken by said camera;

means responsive to the recognized hand position for determining whether or not the operator hand is placed on a display position of the document on the display face of said display; and

display operation means, when the operator hand is placed on the display position of the document, for displaying a part or all of each of the pages of the document on which the operator hand is placed in sequence on said display if motion of the operator hand subsequently recognized is a wave of a thumb of the operator.

19. The information processing system as claimed in claim 18 wherein the processor further includes means for outputting sound effects defined according to the operation performed by said display operation means on display.