Information presenting apparatus, operation processing method therefor, storage medium storing program for executing operation processing

• US 7,136,093 B1
• Filed: 03/17/2000
• Issued: 11/14/2006
• Est. Priority Date: 03/23/1999
• Status: Expired due to Fees

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Ikeda, Yuji, Fujii, Kenichi, Ueda, Takaya, Itoh, Fumiaki, Otani, Noriko
• Primary Examiner(s): MOE, AUNG SOE
• Application Number:
  US09/527,984
• Time in Patent Office: 2,433 Days
• Field of Search: 348/143, 348/159, 348/149, 348/150, 348/153, 348/157, 348/207.99, 348/207.11, 348/705, 348/211.99, 348/211.4, 348/211.11, 348/211.13, 348/211.3, 348/211.8, 348/333.01, 348/333.02, 702/188
• US Class Current: 348/207.11
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries

Abstract

The present invention has as its object to automatically provide information about an object image-sensed by a camera and automatically image-sense and present an object described by browsed information while a user is browsing the information. To achieve this object, the present invention includes scope holding unit, picture operating unit, first instruction unit, picture display unit, map operating unit, second instruction unit, map display unit, document operating unit, third instruction unit, and document display unit.

Claims

1. An information presenting system comprising:

scope holding means for holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera, a map indicating a position of the camera, and a text document;

picture operating means for changing an image-sensing range of the camera;

first instruction means for instructing the camera to switch display pictures when the image-sensing range of the camera is changed by said picture operating means or the scope held in said scope holding means is changed, and instructing said scope holding means to hold a new scope corresponding to a new image-sensing range when the image-sensing range of the camera is changed by said picture operating means;

picture display means for displaying a picture within the image-sensing range of the camera which is designated by an instruction from said first instruction means;

map operating means for changing the scope in said scope holding means by designating an object on the map by giving an instruction;

second instruction means for updating display of a symbol indicating the image-sensing range of the camera which is displayed on the map when the scope is changed by said map operating means or the scope held in said scope holding means is changed, and instructing said scope holding means to hold a new scope when the scope is changed by said map operating means;

map display means for displaying a map designated by an instruction from said second instruction means;

document operating means for changing a display document by operating a text document;

third instruction means for giving an instruction to switch documents when the display document is changed by said document operating means or the scope held in said scope holding means is changed, and instructing said scope holding means to hold a new scope when the display document is changed by said document operating means; and

document display means for displaying the document designated by an instruction from said third instruction means.

2. The system according to claim 1, wherein if the scope held in said scope holding means is changed by said first or third instruction means, and an object corresponding to a new scope is not displayed on said map display means, said map display means is instructed to display the object.

3. The system according to claim 2, wherein said system further comprises storage means for storing maps on different reduced scales, and if the scope held in said scope holding means is changed by said first or third instruction means, and an object corresponding to a new scope is not displayed on said map display means, said second instruction means instructs said map display means to display a map on the smallest reduced scale that can display a corresponding new image-sensing range.

4. The system according to claim 2, wherein if the scope held in said scope holding means is changed by said first or third instruction means, and an object corresponding to a new scope is not displayed on said map display means, said second instruction means instructs said map display means to scroll the displayed map so as to display a corresponding new image-sensing range.

5. The system according to claim 1, wherein if there are a plurality of scopes to be held in said scope holding means, said first instruction means designates control on the camera to image-sense all objects corresponding to the scopes.

6. The system according to claim 5, wherein if the camera cannot simultaneously image-sense the plurality of objects corresponding to the scopes held in said scope holding means, said first instruction means designates control on the camera to image-sense each object at predetermined time intervals.

7. The system according to claim 5, wherein if the camera cannot simultaneously image-sense the plurality of objects corresponding to the scopes held in said scope holding means, said first instruction means displays a panoramic image obtained by image-sensing the respective objects.

8. The system according to claim 1, wherein if the camera cannot image-sense the object corresponding to the scope held in said scope holding means, said first instruction means displays a picture taken in advance.

9. The system according to claim 1, wherein if one scope is held in said scope holding means, said third instruction means instructs said document display means to display a text document having information about an object corresponding to the scope, and if a plurality of scopes are held in said scope holding means, said third instruction means instructs said document display means to display only anchors corresponding to the scopes.

10. The system according to claim 1, wherein said system further comprises acquiring means for acquiring information about a current image-sensing range of the camera, and said second instruction means changes a display mode of a symbol indicating the image-sensing range of the camera depending on whether the information about the current image-sensing range of the camera coincides with the image-sensing range of the camera which is designated by an instruction from said first instruction means.

11. An information presenting method comprising:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera, a map indicating a position of the camera, and a text document;

a picture operating step of changing an image-sensing range of the camera;

a first instruction step of instructing the camera to switch display pictures when the image-sensing-range of the camera is changed in the picture operating step or the scope held in the scope holding step is changed, and giving an instruction to hold a new scope corresponding to a new image-sensing range in the scope holding step when the image-sensing range of the camera is changed in the picture display step;

a picture display step of displaying a picture within the image-sensing range of the camera which is designated by an instruction in the first instruction step;

a map operating step of changing the scope in the scope holding step by designating an object on the map by giving an instruction;

a second instruction step of updating display of a symbol indicating the image-sensing range of the camera which is displayed on the map when the scope is changed in the map operating step or the scope held in the scope holding step is changed, and giving an instruction to hold a new scope in the scope holding step when the scope is changed in the map operating step;

a map display step of displaying a map designated by an instruction from in the second instruction step;

a document operating step of changing a display document by operating a text document;

a third instruction step of giving an instruction to switch documents when the display document is changed in the document operating step or the scope held in the scope holding step is changed, and giving an instruction to hold a new scope in the scope holding step when the display document is changed in the document operating step; and

a document display step of displaying the document designated by an instruction in the third instruction step.

12. The method according to claim 11, wherein if the scope held in the scope holding step is changed by the first or third instruction step, and an object corresponding to a new scope is not displayed on the map display step, the map display step comprises instructing to display the object.

13. The method according to claim 12, wherein the method further comprises the storage step of storing maps on different reduced scales, and the second instruction step comprises, if the scope held in the scope holding step is changed in the first or third instruction step and an object corresponding to a new scope is not displayed in the map display step, giving an instruction to display a map on the smallest reduced scale that can display a corresponding new image-sensing range in the map display step.

14. The method according to claim 12, wherein the second instruction step comprises, if the scope held in the scope holding step is changed in the first or third instruction step and an object corresponding to a new scope is not displayed in the map display step, giving an instruction to scroll the displayed map so as to display a corresponding new image-sensing range in the map display step.

15. The method according to claim 11, wherein the first instruction step comprises, if there are a plurality of scopes to be held in the scope holding step, instructing control on the camera to image-sense all objects corresponding to the scopes.

16. The method according to claim 15, wherein the first instruction step comprises, if the camera cannot simultaneously image-sense the plurality of objects corresponding to the scopes held in the scope holding step, instructing control on the camera to image-sense each object at predetermined time intervals.

17. The method according to claim 15, wherein the first instruction step comprises, if the camera cannot simultaneously image-sense the plurality of objects corresponding to the scopes held in the scope holding step, displaying a panoramic image obtained by image-sensing the respective objects.

18. The method according to claim 11, wherein the first instruction step comprises, if the camera cannot image-sense the object corresponding to the scope held in the scope holding step, displaying a picture taken in advance.

19. The method according to claim 11, wherein the third instruction step comprises, if one scope is held in the scope holding step, giving an instruction to display a text document having information about an object corresponding to the scope in the document display step, and if a plurality of scopes are held in the scope holding step, giving an instructing to display only anchors corresponding to the scopes in the document display step.

20. The method according to claim 11, wherein the method further comprises the acquiring step of acquiring information about a current image-sensing range of the camera, and the second instruction step comprises changing a display mode of a symbol indicating the image-sensing range of the camera depending on whether the information about the current image-sensing range of the camera coincides with the image-sensing range of the camera which is designated by an instruction in the first instruction step.

21. A computer-readable medium storing a program comprising program codes of:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera, a map indicating a position of the camera, and a text document;

a picture operating step of changing an image-sensing range of the camera;

a first instruction step of instructing the camera to switch display pictures when the image-sensing range of the camera is changed in the picture operating step or the scope held in the scope holding step is changed, and giving an instruction to hold a new scope corresponding to a new image-sensing range in the scope holding step when the image-sensing range of the camera is changed in the picture display step;

a picture display step of displaying a picture within the image-sensing range of the camera which is designated by an instruction in the first instruction step;

a map operating step of changing the scope in the scope holding step by instructing an object on the map by giving an instruction;

a second instruction step of updating display of a symbol indicating the image-sensing range of the camera which is displayed on the map when the scope is changed in the map operating step or the scope held in the scope holding step is changed, and giving an instruction to hold a new scope in the scope holding step when the scope is changed in the map operating step;

a map display step of displaying a map designated by an instruction in the second instruction step;

a document operating step of changing a display document by operating a text document;

a third instruction step of giving an instruction to switch documents when the display document is changed in the document operating step or the scope held in the scope holding step is changed, and giving an instruction to hold a new scope in the scope holding step when the display document is changed in the document operating step; and

a document display step of displaying the document designated by an instruction in the third instruction step.

22. The medium according to claim 21, wherein if the scope held in the scope holding step is changed by the first or third instruction step, and an object corresponding to a new scope is not displayed on the map display step, the map display step comprises instructing to display the object.

23. The medium according to claim 22, wherein the medium further comprises a program code of the storage step of storing maps on different reduced scales, and the second instruction step comprises, if the scope held in the scope holding step is changed in the first or third instruction step and an object corresponding to a new scope is not displayed in the map display step, giving an instruction to display a map on the smallest reduced scale that can display a corresponding new image-sensing range in the map display step.

24. The medium according to claim 22, wherein the second instruction step comprises, if the scope held in the scope holding step is changed in the first or third instruction step and an object corresponding to a new scope is not displayed in the map display step, giving an instruction to scroll the displayed map so as to display a corresponding new image-sensing range in the map display step.

25. The medium according to claim 21, wherein the first instruction step comprises, if there are a plurality of scopes to be held in the scope holding step, instructing control on the camera to image-sense all objects corresponding to the scopes.

26. The medium according to claim 25, wherein the first instruction step comprises, if the camera cannot simultaneously image-sense the plurality of objects corresponding to the scopes held in the scope holding step, instructing control on the camera to image-sense each object at predetermined time intervals.

27. The medium according to claim 25, wherein the first instruction step comprises, if the camera cannot simultaneously image-sense the plurality of objects corresponding to the scopes held in the scope holding step, displaying a panoramic image obtained by image-sensing the respective objects.

28. The medium according to claim 21, wherein the first instruction step comprises, if the camera cannot image-sense the object corresponding to the scope held in the scope holding step, displaying a picture taken in advance.

29. The medium according to claim 21, wherein the third instruction step comprises, if one scope is held in the scope holding step, giving an instruction to display a text document having information about an object corresponding to the scope in the document display step, and if a plurality of scopes are held in the scope holding step, giving an instructing to display only anchors corresponding to the scopes in the document display step.

30. The medium according to claim 21, wherein the medium further comprises a program code of the acquiring step of acquiring information about a current image-sensing range of the camera, and the second instruction step comprises changing a display mode of a symbol indicating the image-sensing range of the camera depending on whether the information about the current image-sensing range of the camera coincides with the image-sensing range of the camera which is designated by an instruction in the first instruction step.

31. An information presenting system comprising:

scope holding device adapted to hold a scope indicating an object to which a user is currently giving attention in accordance with a picture sensed by a camera;

picture operating device adapted to change an image-sensing range of the camera;

control device adapted to control the camera to sense the Image-sensing range and setting a new scope corresponding to a new image-sensing range when the image-sensing range of the camera is changed by said picture operating device;

picture display device adapted to display a picture of the image-sensing range of camera; and

text display device adapted to display the text information corresponding to the scope held in the scope holding device, and switch the text information to the new text information corresponding to the new scope when the scope held in said scope holding device is changed to the new scope.

32. The system according to the claim 31, wherein the image-sensing range is determined by at least one of pan, tilt, zoom of the camera.

33. The system according to the claim 32, wherein said picture operating device changes at least one of pan, tilt, and zoom of the camera in response to the cursor operation of the user.

34. The system according to the claim 31, wherein the text information is including a hyper text document.

35. The system according to the claim 31, further comprising scope display device for displaying scope candidate names corresponding to scope candidates able to be hold by said scope holding device.

36. The system according to the claim 35, said scope displaying device displays the name area of the scope hold by said scope holding device in different condition form the other candidate name areas.

37. An information presenting system comprising:

scope holding device adapted to hold a scope indicating an object to which a user is currently giving attention in accordance with text information;

text operating device adapted to change display text information;

control device adapted to control the text Information and setting a new scope corresponding to a new text information when the display text information is changed by said text operating device;

text display device adapted to display the text information; and

picture display device adapted to display a picture of an image-sensing range of a camera corresponding to the scope held in the scope holding device, and switch the display picture to a new display picture corresponding to the new scope when the scope held in said scope holding device is changed to the new scope.

38. The system according to the claim 37, wherein the image-sensing range is determined by at least one of pan, tilt, zoom of the camera.

39. The system according to the claim 37, wherein the text information is including a hyper text document.

40. The system according to the claim 39, wherein said text operating device changes the hyper text document in response to the link operation of the user.

41. The system according to the claim 37, further comprising scope display device for displaying scope candidate names corresponding to scope candidates able to be hold by said scope holding device.

42. The system according to the claim 41, said scope displaying device displays the name area of the scope hold by said scope holding device in different condition form the other candidate name areas.

43. An information presenting system comprising:

scope holding device adapted to hold a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera and text information;

picture operating device adapted to change an Image-sensing range of the camera;

first instruction device adapted to instruct the camera to switch display pictures when the image-sensing range of the picture is changed by said picture operating device or the scope held in said scope holding device is changed, and instruct said scope holding device to hold a new scope, corresponding to a new image-sensing range when the image-sensing range of the camera is changed by said picture operating device;

picture display device adapted to display a picture within the image-sensing range of the camera which is designated by an Instruction from said first instruction device;

text operating device adapted to change display text information;

second instruction device adapted to give an instruction to switch text information when the display text information is changed by said text operating device or the scope held in said scope holding device is changed, and instruct said scope holding device to hold a new scope when the display text information is changed by said text operating device; and

text display device adapted to display the text information designated by an instruction from said second instruction device.

44. An information presenting system comprising:

scope holding device adapted to hold a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera, a position information of the sensed image, and text information;

picture operating device adapted to change the sensed picture;

first instruction device adapted to instruct to switch display pictures when the sensed picture is changed by picture operating device or the scope held in said scope holding device is changed, and instruct said scope holding device to hold a new scope corresponding to a new sensed picture when the sensed picture is changed by said picture operating device;

picture display device adapted to display a picture which is designated by an instruction from said first instruction device;

position operating device adapted to change the scope in said scope holding device by designating an object position by giving an instruction;

second instruction device adapted to update display of position information of the sensed Image which Is displayed when the scope is changed by said position operating device or the scope held in said scope holding devices;

is changed, and instruct said scope holding device to hold a new scope when the scope is changed by said position operating device;

position display device adapted to display a position designated by an instruction from said second instruction device;

text operating device adapted to change a display text information;

third instruction device adapted to give an instruction to switch text information when the display text information is changed by said text operating device or the scope held in said scope holding device is changed, and instruct said scope holding device to hold a new scope when the display text information is changed by said text operating device; and

text display device adapted to display the text information designated by an instruction from said third instruction device.

45. An information presenting method comprising:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with a picture sensed by a camera;

a picture operating step of changing an image-sensing range of the camera

a control step of controlling the camera to sense the image-sensing range and setting a new scope corresponding to a new image-sensing range when the image-sensing range of the camera is changed in said picture operating step;

a picture display step of displaying a picture of the image-sensing range of camera; and

a text display step of displaying the text information corresponding to the scope held in the scope holding step, and switching the text information to the new text information corresponding to the new scope when the scope held in said scope holding step is changed to the new scope.

46. The method according to the claim 45, wherein the image-sensing range is determined by at least one of pan, tilt, zoom of the camera.

47. The method according to the claim 46, wherein said picture operating step changes at least one of pan, tilt, and zoom of the camera in response to the cursor operation of the user.

48. The method according to the claim 45, wherein the text information is including a hyper text document.

49. The method according to the claim 45, further comprising the scope display step of displaying scope candidate names corresponding to scope candidates able to be hold in said scope holding step.

50. The method according to the claim 49, said scope displaying step displays the name area of the scope hold in said scope holding step in different condition form the other candidate name areas.

51. An information presenting method comprising:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with text information;

a text operating step of changing display text information;

a control step of controlling the text information and setting a new scope corresponding to a new text information when the display text information is changed in said text operating step;

a text display step of displaying the text information; and

a picture display step of displaying a picture of an image-sensing range of a camera corresponding to the scope held in the scope holding step, and switching the display picture to a new display picture corresponding to the new scope when the scope held in said scope holding step is changed to the new scope.

52. The method according to the claim 51, wherein the image-sensing range is determined by at least one of pan, tilt, zoom of the camera.

53. The method according to the claim 51, wherein the text information is including a hyper text document.

54. The method according to the claim 53, wherein said text operating device changes the hyper text document in response to the link operation of the user.

55. The method according to the claim 51, further comprising the scope display step of displaying scope candidate names corresponding to scope candidates able to be hold is said scope holding step.

56. The method according to the claim 55, said scope displaying step displays the name area of the scope hold in said scope holding step in different condition form the other candidate name areas.

57. An information presenting method comprising:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera and text information;

a picture operating step of changing an image-sensing range of the camera

a first instruction step of instructing the camera to switch display pictures when the image-sensing range of the picture is changed in said picture operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope corresponding to a new image-sensing range when the image-sensing range of the camera is changed in said picture operating step;

a picture display step of displaying a picture within the image-sensing range of the camera which is designated by an instruction in said first instruction step;

a text operating step of changing display text information;

a second instruction step of giving an instruction to switch text information when the display text information is changed in said text operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope when the display text information is changed in said text operating step; and

a text display step of displaying the text information designated by an instruction in said second instruction step.

58. An information presenting method comprising:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera, a position information of the sensed image, and text information;

a picture operating step of changing the sensed picture;

a first instruction step of instructing to switch display pictures when the sensed picture is changed in picture operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope corresponding to a new sensed picture when the sensed picture is changed in said picture operating step;

a picture display step of displaying a picture which is designated by an instruction in said first instruction step;

a position operating step of changing the scope in said scope holding step by designating an object position by giving an instruction;

a second instruction step of updating display of position information of the sensed image which is displayed when the scope is changed in said position operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope when the scope is changed in said position operating step;

a position display step of displaying a position designated by an instructior in said second instruction step;

a text operating step of changing a display text information;

a third instruction step of giving an instruction to switch text information when the display text information is changed in said text operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope when the display text information is changed in said text operating step; and

a text display step of displaying the text information designated by an instruction in said third instruction step.

59. A computer-readable medium storing a program comprising program codes of:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with a picture sensed by a camera;

a picture operating step of changing an image-sensing range of the camera;

a control step of controlling the camera to sense the image-sensing range and setting a new scope corresponding to a new image-sensing range when the image-sensing range of the camera is changed in said picture operating step;

a picture display step of displaying a picture of the image-sensing range of camera; and

a text display step of displaying the text information corresponding to the scope held in the scope holding step, and switching the text information to the new text information corresponding to the new scope when the scope held in said scope holding step is changed to the new scope.

60. A computer-readable medium storing a program comprising program codes of:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with text information;

a text operating step of changing display text information;

a control step of controlling the text information and setting a new scope corresponding to a new text information when the display text information is changed in said text operating step;

a text display step of displaying the text information; and

a picture display step of displaying a picture of an image-sensing range of camera corresponding to the scope held in the scope holding step, and switching the display picture to a new display picture corresponding to the new scope when the scope held in said scope holding step is changed to the new scope.

61. A computer-readable medium storing a program comprising program codes of:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera and text information;

a picture operating step of changing an image-sensing range of the camera;

a first instruction step of instructing the camera to switch display pictures when the image-sensing range of the picture is changed in said picture operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope corresponding to a new image-sensing range when the image-sensing range of the camera is changed in said picture operating step;

a picture display step of displaying a picture within the image-sensing range of the camera which is designated by an instruction in said first instruction step;

a text operating step of changing display text information;

a second instruction step of giving an instruction to switch text information when the display text information is changed in said text operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope when the display text information is changed in said text operating step; and

a text display step of displaying the text information designated by an instruction in said second instruction step.

62. A computer-readable medium storing a program comprising program codes of:

a scope holding step of holding a scope indicating an object to which a user is currently giving attention in accordance with at least one of a picture sensed by a camera, a position information of the sensed image, and text information;

a picture operating step of changing the sensed picture;

a first instruction step of instructing to switch display pictures when the sensed picture is changed in picture operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope corresponding to a new sensed picture when the sensed picture is changed in said picture operating step;

a picture display step of displaying a picture which is designated by an instruction in said first instruction step;

a position operating step of changing the scope in said scope holding step by designating an object position by giving an instruction;

a second instruction step of updating display of position information of the sensed image which is displayed when the scope is changed in said position operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope when the scope is changed in said position operating step;

a position display step of displaying a position designated by an instruction in said second instruction step;

a text operating step of changing a display text information;

a third instruction step of giving an instruction to switch text information when the display text information is changed in said text operating step or the scope held in said scope holding step is changed, and instructing said scope holding step to hold a new scope when the display text information is changed in said text operating step; and

a text display step of displaying the text information designated by an instruction in said third instruction step.