Input/display integrated information processing device

• US 5,742,279 A
• Filed: 11/08/1994
• Issued: 04/21/1998
• Est. Priority Date: 11/08/1993
• Status: Expired due to Fees

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Fujimoto, Makoto, Yamamoto, Hiroshi, Kojima, Yoshihiro, Maruno, Susumu, Kayashima, Kazuhiro, Shimeki, Yasuharu
• Primary Examiner(s): Liang, Regina
• Application Number:
  US08/337,372
• Time in Patent Office: 1,260 Days
• Field of Search: 178/18, 178/20, 178/19, 348/589, 348/600, 348/601, 358/505, 358/509, 358/512-514, 358/448, 358/450, 345/173-179
• US Class Current: 345/173
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00129 with a display device, e.g. CRT or LCD monitor with a television apparatus H04N1/00283; arrangements for control of display devices G09G
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/028 for picture information pick-up
• CPC Class Codes: H04N 1/1017 the main-scanning components remaining positionally invariant with respect to one another in the sub-scanning direction
• CPC Class Codes: H04N 1/193 using electrically scanned linear arrays , e.g. linear CCD arrays
• CPC Class Codes: H04N 2201/0438 Scanning displays; Scanning large surfaces, e.g. projection screens, writing boards

Abstract

An input/display integrated information processing device has: image display circuit for displaying document and image information; image input circuit through which information of an image such as a picture, a photograph, documents drawn or written on a sheet presented by the user can be an input; a visual coincidence structure for integrally combining a display screen of the image display circuit with an input screen of the image input circuit so as to establish visual coincidence of screens as viewed from the user; contact information detection circuit for, when a finger of the user, the sheet presented by the user, or the like makes contact with the contact information detection circuit, detecting information of a contact position, the contact information detection circuit being disposed on the whole of the input screen of the image input circuit or the display screen of the image display circuit; image extraction circuit for automatically extracting only a required portion from image information input through the image input circuit; image information storage circuit for storing the image information; image synthesize circuit for combining the image with an image which is already displayed and stored; and image information control circuit for controlling input/output operations of the image information.

Claims

1. An input/display integrated information processing device comprising:

image display means for displaying image information;

image input means for inputting two-dimensional image information of a two-dimensional image prepared prior to image information input by said input means, said image input means includes;

a line light source for illuminating a presented article on said input screen,

a line optical sensor for reading one-dimensional light reflected by the presented article,

sensor drive means for driving said line light source and said line optical sensor, and

read control means for controlling said sensor drive means, said read control means including background light elimination means for, at each reading of one line, detecting image information from a difference between an output of said line optical sensor in the case where said line light source is on, and an output of said line optical sensor in the case where said line light source is off, thereby reducing noise due to external light from illumination;

a visual coincidence structure for integrally combining a display screen of said image display means with an input screen of said image input means so as to establish visual coincidence of said screens as viewed from an user;

image extraction means for extracting a previously identified portion from image information input through said image input means;

image information storage means for storing the image information of the two-dimensional image;

image information control means for controlling input/output operations of the image information; and

wherein, in the integral combination in said visual coincidence structure, said image input means is placed before said image display means as viewed from the user.

2. An input/display integrated information processing device according to claim 1, wherein said image input means further includes an optical filter disposed between said line light source and said line optical sensor and through which only light from said line light source is transmitted.

3. An input/display integrated information processing device according to claim 2, wherein said image input means further includes scan control means for, in accordance with an output of said line optical sensor, controlling said line light source and said line optical sensor so as to scan only a portion corresponding to the two-dimensional image placed by the user.

4. An input/display integrated information processing device comprising:

image display means for displaying image information;

image input means for inputting two-dimensional image information of a two-dimensional image prepared prior to image information input by said input means;

a visual coincidence structure for integrally combining a display screen of said image display means with an input screen of said image input means so as to establish visual coincidence of said screens as viewed from an user;

image extraction means for extracting a previously identified portion from image information input through said image input means, said image extraction means includes;

an object image extraction means and a required portion extraction means for detecting a closed curve, when the user previously draws the closed curve enclosing a portion of the two-dimensional image, and

an image information control means;

image information storage means for storing the image information of the two-dimensional image;

image information control means for controlling input/output operations of the image information; and

wherein, in the integral combination in said visual coincidence structure, said image input means is placed before said image display means as viewed from the user; and

said required portion extraction means includes;

extreme point detection means to scan the image information and to set a first black pixel larger than at least one adjacent white pixel as an extreme point,

closed curve trace means to scan around the extreme point to detect adjacent black pixels next to white pixels and to trace the closed curve until the extreme point is reached,

closed curve position storage means, said closed curve trace means sending curve information to said closed curve position storage means, and

internal image extraction means controlling said closed curve position storage means to output the curve information to said image information control means for extracting the image information within the closed curve.

5. An input/display integrated information processing device comprising:

image display means for displaying image information;

image input means for inputting two-dimensional image information of a two-dimensional image prepared prior to image information input by said input means, said image input means includes;

a line light source for illuminating a presented article on said input screen,

a line optical sensor for reading one-dimensional light reflected by the presented article,

sensor drive means for drifting said line light source and said line optical means, and

read control means for controlling said sensor drive means, said read control means including background light elimination means for, at each reading of one line, detecting image information from a difference between an output of said line optical sensor in the case where said line light source is on, and an output of said line optical sensor in the case where said line light source is off, thereby reducing noise due to external light from illumination;

a visual coincidence structure for integrally combining a display screen of said image display means with an input screen of said image input means so as to establish visual coincidence of said screens as viewed from an user;

image extraction means for extracting a previously identified portion from image information input through said image input means;

image information storage means for storing the image information of the two-dimensional image;

image information control means for controlling input/output operations of the image information; and

wherein, in the integral combination in said visual coincidence structure, said image input means is placed behind said image display means as viewed from the user.

6. An input/display integrated information processing device according to claim 5, wherein said image input means further includes an optical filter disposed between said line light source and said line optical sensor and through which only light from said line light source is transmitted.

7. An input/display integrated information processing device according to claim 6, wherein said image input means further includes scan control means for, in accordance with an output of said line optical sensor, controlling said line light source and said line optical sensor so as to scan only a portion corresponding to the two-dimensional image placed by the user.

8. An input/display integrated processing device comprising:

image display means for displaying image information;

image input means for inputting two-dimensional image information of a two-dimensional image prepared prior to image information input by said input means;

a visual coincidence structure for integrally combining a display screen of said image display means with an input screen of said image input means so as to establish visual coincidence of said screens as viewed from an user;

image extraction means for extracting a previously identified portion from image information input through said image input means, said image extraction means includes;

an object image extraction means and a required portion extraction means for detecting the closed curve, when the user previously draws a closed curve enclosing a portion of the two-dimensional image, and

an image information control means;

image information storage means for storing the image information of the two-dimensional image;

image information control means for controlling input/output operations of the image information;

wherein, in the integral combination in said visual coincidence structure, said image input means is placed behind said image display means as viewed from the user; and

said required portion extraction means includes;

extreme point detection means to scan the image information and to set a first black pixel larger than at least one adjacent white pixel as an extreme point,

closed curve trace means to scan around the extreme point to detect adjacent black pixels next to white pixels and to trace the closed curve until the extreme point is reached,

closed curve position storage means, said closed curve trace means sending curve information to said closed curve position storage means, and

internal image extraction means controlling said closed curve position storage means to output the curve information to said image information control means for extracting the image information within the closed curve.