Interactive information processing system responsive to user manipulation of physical objects and displayed images

• US 5,917,490 A
• Filed: 10/21/1997
• Issued: 06/29/1999
• Est. Priority Date: 03/15/1994
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Arai, Toshifumi, Shojima, Hiroshi, Kuzunuki, Soshiro, Kitamura, Tadaaki
• Primary Examiner(s): HUYNH, BA
• Application Number:
  US08/955,151
• Time in Patent Office: 616 Days
• Field of Search: 345/335, 345/339, 345/350, 345/351, 345/358, 345/968
• US Class Current: 715/775
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386

Abstract

An information processing system and method using a file storage unit which stores electronic information and a display unit which displays the electronic information. A discrimination unit discriminates each of a plurality of physical objects indicated by a user. An attribute discrimination unit discriminates changeable attribute information of the physical objects. A link storage unit stores link information designating a correspondence between each of the physical objects and a respective corresponding portion of the electronic information stored in the storage unit. A file operation unit performs a plurality of operations, including: (a) changing an appearance of the electronic information on the display when the electronic information displayed is the corresponding portion of the electronic information which corresponds to at least one of the physical objects; (b) performing different or additional operations on the corresponding portion of the electronic information which corresponds to at least one of the physical objects when the corresponding portion of the electronic information is manipulated; and (c) changing attributes of the corresponding portion of the electronic information which corresponds to at least one of the physical objects when the changeable attribute information of at least one of the physical objects is changed.

Claims

1. An information processing system, comprising:

a file storage unit which stores electronic information;

a display unit which displays said electronic information;

a discrimination unit which discriminates each of a plurality of physical objects indicated by a user;

a link storage unit which stores link information designating a correspondence between each of said physical objects and a respective corresponding portion of the electronic information stored in said storage unit; and

a file operation unit which changes an appearance of the electronic information on the display when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects.

2. An information processing system according to claim 1, wherein another portion of said electronic information which does not correspond to said physical objects is displayed on the display device in an unlinked appearance, said file operation unit changing the appearance of the electronic information to a linked appearance when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects, said linked appearance being different from said unlinked appearance.

3. An information processing system according to claim 2, wherein said unlinked appearance is a standard icon, and said linked appearance is a modified icon.

4. A method of information processing, said method comprising the acts of:

storing electronic information in a file storage unit;

displaying said electronic information on a display unit;

discriminating each of a plurality of physical objects indicated by a user using a discrimination unit;

storing link information designating a correspondence between each of said physical objects and a respective corresponding portion of the electronic information stored in said storage unit in a link storage unit; and

changing an appearance of the electronic information on the display when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects using a file operation unit.

5. A method of information processing according to claim 4, wherein another portion of said electronic information which does not correspond to said physical objects is displayed on the display device with an unlinked appearance, said changing act changing the appearance of the electronic information to a linked appearance when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects, said linked appearance being different from said unlinked appearance.

6. A method of information processing according to claim 5, wherein said unlinked appearance is a standard icon, and said linked appearance is a modified icon.

7. An information processing system, comprising:

a file storage unit which stores electronic information;

a display unit which displays said electronic information;

a discrimination unit which discriminates each of a plurality of physical objects indicated by a user;

a link storage unit which stores link information designating a correspondence between each of said physical objects and a respective corresponding portion of the electronic information stored in said storage unit; and

a file operation unit which performs different or additional operations on said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said corresponding portion of the electronic information is manipulated.

8. An information processing system according to claim 7, wherein said different or additional operations comprise issuing a warning message when the user attempts to delete or move said corresponding portion of the electronic information.

9. An information processing system according to claim 7, wherein said file operation unit changes an appearance of the electronic information on the display when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects.

10. A method of information processing, said method comprising the acts of:

storing electronic information in a file storage unit;

displaying said electronic information on a display unit;

discriminating each of a plurality of physical objects indicated by a user using a discrimination unit;

storing link information designating a correspondence between each of said physical objects and a respective corresponding portion of the electronic information stored in said storage unit using a link storage unit; and

performing different or additional operations on said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said corresponding portion of the electronic information is manipulated using a file operation unit.

11. A method of information processing according to claim 10, wherein said performing different or additional operations act comprises issuing a warning message when the user attempts to delete or move said corresponding portion of the electronic information.

12. An information processing system according to claim 10, further comprising the act of changing an appearance of the electronic information on the display when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects using said file operation unit.

13. An information processing system, comprising:

a file storage unit which stores electronic information;

a display unit which displays said electronic information;

a discrimination unit which discriminates each of a plurality of physical objects indicated by a user;

an attribute discrimination unit which discriminates changeable attribute information of said physical objects;

a link storage unit which stores link information designating a correspondence between each of said physical objects and a respective corresponding portion of the electronic information stored in said storage unit; and

a file operation unit which changes attributes of said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said changeable attribute information of at least one of said physical objects is changed.

14. An information processing system according to claim 13, wherein said changeable attribute information of said physical objects comprises at least one check box located on the physical object.

15. An information processing system according to claim 13, wherein said file operation unit changes an appearance of the electronic information on the display when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects.

16. An information processing system according to claim 13, wherein said file operation unit performs different or additional operations on said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said corresponding portion of the electronic information is manipulated.

17. An information processing system according to claim 15, wherein said file operation unit performs different or additional operations on said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said corresponding portion of the electronic information is manipulated.

18. A method of information processing, said method comprising the acts of:

storing electronic information in a file storage unit;

displaying said electronic information on a display unit;

discriminating each of a plurality of physical objects indicated by a user using a discrimination unit;

discriminating changeable attribute information of said physical objects using an attribute discrimination unit;

storing link information designating a correspondence between each of said physical objects and a respective corresponding portion of the electronic information stored in said storage unit in a link storage unit; and

changing attributes of said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said changeable attribute information of at least one of said physical objects is changed using a file operation unit.

19. A method of information processing according to claim 18, wherein said changeable attribute information of said physical objects comprises at least one check box located on the physical object.

20. A method of information processing according to claim 18, further comprising the act of changing an appearance of the electronic information on the display when the electronic information displayed is said corresponding portion of the electronic information which corresponds to at least one of said physical objects using said file operation unit.

21. A method of information processing according to claim 18, further comprising the act of performing different or additional operations on said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said corresponding portion of the electronic information is manipulated using a file operation unit.

22. A method of information processing according to claim 20, further comprising the act of performing different or additional operations on said corresponding portion of the electronic information which corresponds to at least one of said physical objects when said corresponding portion of the electronic information is manipulated using a file operation unit.