METHODS AND SYSTEMS FOR MULTIMEDIA TRAJECTORY ANNOTATION

• US 20140226852A1
• Filed: 02/14/2013
• Published: 08/14/2014
• Est. Priority Date: 02/14/2013
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Bernal, Edgar A., Wu, Wencheng, Xu, Beilei, Loce, Robert P., Bala, Raja, Schweid, Stuart A., Li, Qun
• Granted Patent: US 9,536,152 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A system and method of providing annotated trajectories by receiving image frames from a video camera and determining a location based on the image frames from the video camera. The system and method can further include the steps of determining that the location is associated with a preexisting annotation and displaying the preexisting annotation. Additionally or alternatively, the system and method can further include the steps of generating a new annotation automatically or based on a user input and associating the new annotation with the current location.

Claims

1. A method of providing annotated trajectories, the method comprising:

receiving at least one image frame from a video camera, wherein the at least one image frame comprises at least one feature point;

determining a location based on the at least one feature point of the at least one image frame;

generating an annotation; and

associating the annotation with the location.

2. The method of claim 1, wherein generating the annotation is triggered by audio received via a microphone, a current time matching a pre-specified time stamp, input received from the user, or a combination thereof.

3. The method of claim 1, wherein the annotation is automatically generated based on the location, audio received via a microphone, a current time, input received from a user, or combinations thereof.

4. The method of claim 1, wherein the method is performed on a first mobile device and the annotation is automatically generated based on communication with a second mobile device.

5. The method of claim 1, wherein:

the annotation is generated based on an input by a user; and

the input by the user is voice, text, a touch, a shake, or a combination thereof.

6. The method of claim 1, further comprising:

determining that the location is associated with a preexisting annotation; and

displaying the preexisting annotation.

7. The method of claim 1, further comprising:

receiving a search query from a user;

determining that the search query matches one or more aspects of the annotation; and

displaying an indication of a direction of and distance to the location.

8. The method of claim 1, wherein determining the location based on the at least one feature point of the at least one image frame comprises:

identifying the at least one feature point in the at least one image frame from the video camera;

determining feature point information for the at least one feature point;

receiving at least one subsequent image frame from the video camera; and

identifying the at least one feature point in the at least one subsequent image frame from the video camera, wherein the location is determined based on changes in positions of the at least one features point between the at least one image frame and the at least one subsequent image frame.

9. A method of providing annotated trajectories, the method comprising:

receiving at least one image frame from a video camera, wherein the at least one image frame comprises at least one feature point;

determining a location based on the at least one feature point of the at least one image frame;

determining that the location is associated with an annotation; and

displaying the annotation.

10. The method of claim 9, wherein the annotation comprises textual information, an image, an audio file, a video file, or a combination thereof.

11. The method of claim 9, further comprising:

generating an new annotation; and

associating the new annotation with the location.

12. The method of claim 11, wherein the new annotation is automatically generated based on the location.

13. The method of claim 11, wherein the method is performed on a first mobile device and the new annotation is automatically generated based on communication with a second mobile device.

14. The method of claim 11, wherein:

the annotation is generated based on an input by a user; and

the input by the user is voice, text, a touch, a shake, or a combination thereof.

15. The method of claim 9, wherein determining the location based on the at least one feature point of the at least one image frame comprises:

identifying the at least one feature point in the at least one image frame from the video camera;

determining feature point information for the at least one feature point;

receiving at least one subsequent image frame from the video camera; and

identifying the at least one feature point in the at least one subsequent image frame from the video camera, wherein the location is determined based on changes in positions of the at least one features point between the at least one image frame and the at least on subsequent image frame.

16. A system for providing annotated trajectories comprising:

a processing system comprising one or more processors; and

a memory system comprising one or more computer-readable media, wherein the one or more computer-readable media contain instructions that, when executed by the processing system, cause the processing system to perform operations comprising;

receiving at least one image frame from a video camera, wherein the at least one image frames comprises at least one feature point;

determining a location based on the at least one feature point of the at least one image frame;

generating an annotation; and

associating the annotation with the location.

17. The system of claim 16, wherein the annotation is automatically generated.

18. The system of claim 16, wherein:

the annotation is generated based on an input by a user; and

the input by the user is voice, text, a touch, a shake, or a combination thereof.

19. The system of claim 16, the operations further comprising:

determining that the location is associated with a preexisting annotation; and

displaying the preexisting annotation.

20. The system of claim 16, wherein determining the location based on the at least one feature point of the at least one image frame comprises:

identifying at least one feature point in the at least one image frame from the video camera;

determining feature point information for the at least one feature point;

receiving at least one subsequent image frame from the video camera; and

identifying the at least one feature point in the at least one subsequent image frame from the video camera, wherein the location is determined based on changes in positions of the at least one features point between the at least one image frame and the at least one subsequent image frame.