Information processing system and information processing method

• US 7,680,360 B2
• Filed: 01/25/2006
• Issued: 03/16/2010
• Est. Priority Date: 08/16/2005
• Status: Expired due to Fees

• Current Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Andoh, Yutaka, Omura, Kengo, Nagamine, Takeshi
• Primary Examiner(s): Kassa; Yosef
• Application Number:
  US11/338,830
• Publication Number:
  US 20070041666A1
• Time in Patent Office: 1,511 Days
• Field of Search: 382/209, 382/219, 382/282, 382/305, 707/3, 707/6
• US Class Current: 382/305
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content

Abstract

An information processing system includes a memory portion that stores image information of a space in association with a document, the image information being captured by an image capturing portion, the document being used while the space being captured, a receiving portion that receives information that specifies the document as a search request, and a search portion that searches the image information stored on the memory portion for a scene associated with the document specified by the search request, on the basis of the search request.

Claims

1. An information processing system comprising:

a memory portion that stores image information of a surrounding space in association with a document, the image information being captured by an image capturing portion, the document being used while the surrounding space is being captured,

a receiving portion that receives information that specifies the document as a search request; and

a search portion that searches the image information stored on the memory portion for a scene associated with the document specified by the search request, on the basis of the search request.

2. The information processing system, according to claim 1, wherein the receiving portion receives the information that specifies the document as the search request in a format where file contents of the document are arranged in a given area.

3. The information processing system, according to claim 1, wherein the receiving portion receives a format of the document as the information that specifies the document.

4. The information processing system, according to claim 1, wherein the receiving portion receives the search request in a format where a layout chart of the surrounding space is displayed on a retrieval screen and an indicator that indicates a position of an object is arranged on the layout chart of the surrounding space.

5. The information processing system, according to claim 1, wherein the receiving portion receives the search request in a format where a layout chart of the surrounding space is displayed on a retrieval screen and an indicator that indicates a position of the document is displayed on the layout chart of the surrounding space.

6. The information processing system, according to claim 1, wherein:

the memory portion stores the image information in association with at least one of position information of an object in the surrounding space, a remark state of a person in the surrounding space, and an operation state of a device in the surrounding space, as attribute information; and

the receiving portion receives the attribute information as the search request.

7. The information processing system, according to claim 1, wherein the receiving portion displays at least one of a first selector that selects the surrounding space, a second selector that selects a date when the image information was captured, a first area that specifies a person, a second area that specifies the document, a third area that displays a layout chart of the surrounding space, and a first indicator that indicates a remark state of a person, and receives the search request according to an operation on a retrieval screen.

8. The information processing system, according to claim 1, further comprising:

a display portion that displays a downsized image of the scene that has been searched by the search portion to correspond to a timeline of the image information.

9. The information processing system, according to claim 1, wherein the memory portion stores the document in association with each scene of the image information.

10. The information processing system, according to claim 1, wherein if the document is a slide, the memory portion stores information on each page of the slide in association with each scene of the image information.

11. The information processing system, according to claim 1, wherein if the document is a slide, the memory portion stores information on a title of each page of the slide in association with each scene of the image information.

12. An information processing system comprising:

an image capturing portion that captures a surrounding space;

a recognition portion that recognizes a document that is used while the surrounding space is being captured; and

an applying portion that applies information on the document recognized by the recognition portion to image information captured by the image capturing portion, as a search index.

13. The information processing system according to claim 12, wherein if the document is a slide, the applying portion applies information on each page of the slide to each scene of the image information as the search index.

14. The information processing system according to claim 12, wherein if the document is the slide, the applying portion applies information on a title of each page of the slide to each scene of the image information as the search index.

15. An information processing method comprising:

receiving information that specifies a document as a search request;

searching image information stored in a memory portion for a scene associated with the document on the basis of the search request, the image information being captured by an image capturing portion and being stored in the memory portion in association with the document used while a surrounding space is being captured; and

displaying information of the scene that has been searched.

16. The information processing method according to claim 15, further comprising:

displaying a layout chart of the surrounding space on a retrieval screen; and

receiving the search request in a format where the layout chart of the surrounding space is displayed on the retrieval screen and an indicator that indicates a position of an object is arranged on the layout chart of the surrounding space.

17. The information processing method according to claim 15, further comprising:

displaying a layout chart of the surrounding space on a retrieval screen; and

receiving the search request in a format where the layout chart of the surrounding space is displayed on the retrieval screen and an indicator that indicates a position of the document is displayed on the layout chart of the surrounding space.

18. The information processing method, according to claim 15, further comprising steps of:

displaying at least one of a first selector that selects the surrounding space, a second selector that selects a date when the image information is captured, a first area that specifies a person, a second area that specifies the document, a third area that displays a layout chart of the surrounding space, and a first indicator that indicates a remark state of a person; and

receiving the search request according to an operation on a retrieval screen.

19. The information processing method according to claim 15, further comprising:

a step of displaying a downsized image of the scene that has been searched by the search portion to correspond to a timeline of the image information.

20. An information processing method comprising:

capturing a surrounding space;

recognizing a document that is used while the surrounding space is being captured; and

applying information on the document that has been recognized to image information of the surrounding space that has been captured, as a search index.

21. The information processing method according to claim 20, wherein if the document is a slide, the step of applying applies information on each page of the slide to each scene of the image information as the search index.

22. The information processing method according to claim 20, wherein if the document is a slide, the step of applying applies information on a tile of each page of the slide to each scene of the image information as the search index.