SYSTEM FOR VIDEO CONTROL BY DIRECT MANIPULATION OF OBJECT TRAILS

• US 20080263592A1
• Filed: 08/14/2007
• Published: 10/23/2008
• Est. Priority Date: 04/18/2007
• Status: Abandoned Application

• Current Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Original Assignee: Fuji Xerox Company Limited (Xerox Holdings Corp.)
• Inventors: Yang, Tao, Girgensohn, Andreas, Kimber, Donald G., Shipman, Frank M., Dunnigan, Anthony Eric, Turner, Althea Ann
• Application Number:
  US11/838,659
• Publication Number:
  US 20080263592A1
• Time in Patent Office: Days
• US Class Current: 725/38
• CPC Class Codes: G06F 3/0486 Drag-and-drop

Abstract

One embodiment is a method for an interaction technique allowing users to control nonlinear video playback by directly manipulating objects seen in the video playback, comprising the steps of: tracking a moving object on a camera; recording a video; creating an object trail for the moving object which corresponds to the recorded video; allowing the user to select a point in the object trail; and displaying a frame in the recorded video that corresponds with the selected point in the object trail.

Claims

1. A method for an interaction technique allowing users to control nonlinear video playback by directly manipulating objects seen in the video playback, comprising the steps of:

tracking a moving object on a camera;

recording a video;

creating an object trail for the moving object which corresponds to the recorded video;

allowing the user to select a point in the object trail;

displaying the point in the recorded video that corresponds with the selected point in the object trail.

2. The method of claim 1, further comprising the step of:

displaying the object trail to a user.

3. The method of claim 1, further comprising the step of:

allowing the user to drag the moving object along the object trail in the recorded video.

4. The method of claim 1, wherein the interaction technique relies on a video tracking system that tracks objects in fixed cameras, maps them into 3D space, and handles hand-offs between cameras.

5. The method of claim 4, wherein the users can drag iconic object representations on a floor plan.

6. The method of claim 5, wherein a best video view is selected for a dragged object.

7. The method of claim 1, wherein world geometry is used to enable track across cameras.

8. The method of claim 1, wherein metadata defines the trails of people and objects in the video.

9. The method of claim 1, wherein at each frame time, each tracked object is associated with an image region bounding box, which is entered into a database with an identifier for the tracked object.

10. The method of claim 1, wherein a Gaussian mixture model approach is used for pixel level background modeling to segment people from the background for single camera video analysis.

11. The method of claim 1, wherein foreground segmentation is achieved by analyzing foreground density around each pixel to determine a candidate set of foreground pixels and the difference is found from the neighborhood image using a normalized cross-correlation computed using an integral image method.

12. The method of claim 1, wherein a correspondence matrix is used to classify an object'"'"'s interactions with other objects for single camera tracking in a data association module.

13. The method of claim 12, wherein classes comprise Appear, Disappear, Continue, Merge, and Split.

14. The method of claim 1, wherein identity maintenance is handled by occlusion by a track-based Bayesian segmentation algorithm using appearance features.

15. The method of claim 13, wherein Merges and Splits are entered into a database.

16. A computer-readable medium containing instructions stored thereon, wherein the instructions comprise an interaction technique allowing users to control nonlinear video playback by directly manipulating objects seen in the video playback, comprising:

tracking a moving object on a camera;

recording a video;

creating an object trail for the moving object which corresponds to the recorded video;

allowing the user to select a point in the object trail;

displaying the point in the recorded video that corresponds with the selected point in the object trail.

17. The computer-readable medium of claim 16, further comprising:

displaying the object trail to a user.

18. The computer-readable medium of claim 16, further comprising:

allowing the user to drag the moving object along the object trail in the recorded video.

19. The computer-readable medium of claim 16, wherein the interaction technique relies on a video tracking system that tracks objects in fixed cameras, maps them into 3D space, and handles hand-offs between cameras.

20. The computer-readable medium of claim 16, wherein the users can drag iconic object representations on a floor plan.

21. The computer-readable medium of claim 16, wherein a best video view is selected for a dragged object.

22. The computer-readable medium of claim 16, wherein world geometry is used to enable track across cameras.

23. A method for an interaction technique allowing users to control nonlinear video playback by directly manipulating optical flow around a point with texture in the video playback, comprising the steps of:

recording a video;

creating an optical flow around a point with texture which corresponds to the recorded video;

allowing the user to select a point in the optical flow;

displaying the point in the recorded video that corresponds with the selected point in the optical flow.

24. A computer-readable medium containing instructions stored thereon, wherein the instructions comprise:

an interaction technique allowing users to control nonlinear video playback by directly manipulating optical flow around a point with texture in the video playback, comprising the steps of;

recording a video;

creating an optical flow around a point with texture which corresponds to the recorded video;

allowing the user to select a point in the optical flow;

displaying the point in the recorded video that corresponds with the selected point in the optical flow.