Systems and methods for reviewing video content

• US 10,431,259 B2
• Filed: 03/31/2015
• Issued: 10/01/2019
• Est. Priority Date: 04/23/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Pictures Entertainment Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Bredow, Rob, Limberger, Rene, Richards, Sam
• Primary Examiner(s): Topgyal, Gelek W
• Application Number:
  US14/674,695
• Publication Number:
  US 20150310896A1
• Time in Patent Office: 1,645 Days
• Field of Search: None
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/326 used signal is a video-frame or a video-field (P.I.P.)
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D

Abstract

Systems and methods provide techniques for reviewing content, such as reviewing video on a mobile device. A computing device with a touch screen interface, e.g., a tablet computer, executes a reviewing tool, e.g., a computer program, that causes the device to display video content and information about the video content. The tool provides an interface for selecting video, images, and information, for review and for annotation. The tool uses remote and/or local data to display video, images, and information for review.

Claims

1. A method for reviewing content, comprising:

a. receiving data entered by a user about a first plurality of scenes for review;

b. on a user interface of a first computing device, displaying indicators of the first plurality of scenes for review;

c. highlighting one of the first plurality, the highlighted indicator corresponding to an indicator of a current scene for review;

d. by analyzing data corresponding to the first plurality, determining indicators of a second plurality of scenes for review;

e. displaying the determined indicators of the second plurality of scenes, the second plurality of scenes constituting context scenes associated with the current scene for review; and

f. upon activation of a scene in the first or second plurality, displaying a third plurality of scenes, the third plurality of scenes corresponding to historical versions of the activated scene, wherein the historical versions of the activated scene correspond to different takes of the scene;

g. wherein the indicators of the second plurality of scenes are only displayed for the highlighted one of the first plurality, and such that the indicators of the first and second pluralities of scenes constitute intersecting carousel type user interfaces, such that, by swiping actions, an indicator may be placed at an intersection of the intersecting carousel type user interfaces, and such that the highlighting one of the first plurality causes the highlighted indicator to be placed at the intersection.

2. The method of claim 1, wherein the indicators of the first plurality are disposed along a first straight axis.

3. The method of claim 2, wherein the first straight axis is a vertical axis.

4. The method of claim 1, wherein the indicators of the second plurality are disposed along a second straight axis.

5. The method of claim 4, wherein the second straight axis is a horizontal axis.

6. The method of claim 5, wherein an indicator of a first context scene is disposed to a left of an indicator of the current scene, and an indicator of a second context scene is disposed to a right of the indicator of the current scene, and wherein the first context scene is a scene occurring in time directly before the current scene, and the second context scene is a scene occurring in time directly following the current scene.

7. The method of claim 5, further comprising creating an enlarged frame or window at the intersection, and displaying a playback of the current scene in the created enlarged frame or window at the intersection.

8. The method of claim 7, wherein upon activation of the separate frame or window, or the frame or window at the intersection, transmitting a signal to transform the user interface such that the current scene is caused to play back in a full-screen view.

9. The method of claim 8, wherein upon the transforming, further comprising displaying a user interface for a tool to operate on the current scene.

10. The method of claim 9, wherein the tool is a tool for annotation of the current scene, a tool for adjustment of the current scene, a shuttle tool, a filter tool, a playlist tool, or a combination of the above tools.

11. The method of claim 10, wherein the tool for annotation includes an annotation tool selected from the group consisting of:

a laser pointer tool or a mark-on tool.

12. The method of claim 10, wherein the tool for adjustment enables adjustment of a scene aspect selected from the group consisting of:

exposure, brightness, cropping, color, and combinations of the above.

13. The method of claim 10, wherein the playlist tool for adjustment enables functions selected from the group consisting of:

copying, adding, deleting, changing order, building new playlists, and combinations of the above.

14. The method of claim 9, wherein the tool appears on the right or left side of the user interface when the user interface is in a landscape orientation.

15. The method of claim 1, wherein the indicators of the first and second plurality are thumbnails.

16. The method of claim 1, further comprising creating a user interface element of a separate frame or window and displaying a playback of the current scene in the created separate frame or window.

17. The method of claim 1, further comprising displaying a window with metadata for each of the third plurality of scenes.

18. The method of claim 1, wherein the first and second plurality of scenes are sourced from a server.

19. The method of claim 18, further comprising:

a. displaying data representing the first and second plurality of scenes on a user interface of a second computing device;

b. receiving data corresponding to a first annotation associated with the current scene from the first computing device;

c. receiving data corresponding to a second annotation associated with the current scene from the second computing device; and

d. and storing data corresponding to the first and second annotations associated with the current scene on the server.

20. The method of claim 19, wherein the first annotation is received when the first computing device has control of an editing session, and further comprising disallowing receiving a second annotation from the second computing device when the first computing device has the control of the editing session.

21. The method of claim 19, further comprising receiving audio from the first or the second computing device, and sharing the audio with the second or the first computing device, respectively.

22. The method of claim 21, wherein the audio is shared in real-time.

23. The method of claim 1, wherein the first plurality of scenes correspond to different shots within a movie or television episode, and wherein the second plurality of scenes correspond to, for a selected one of the first plurality, scenes occurring before and after the selected one of the first plurality.

24. The method of claim 23, wherein the first plurality of scenes corresponds to different takes of a scene.

25. A method for reviewing content, comprising:

a. receiving data entered by a user about a first plurality of scenes for review, the first plurality of scenes constituting a collection of medical images corresponding to a diagnosis;

b. on a user interface of a first computing device, displaying indicators of the first plurality of scenes for review;

c. highlighting one of the first plurality, the highlighted indicator corresponding to an indicator of a current scene for review;

d. by analyzing data corresponding to the first plurality, determining indicators of a second plurality of scenes for review, the second plurality of scenes constituting context images related to the highlighted one of the first plurality;

e. displaying the determined indicators of the second plurality of scenes; and

f. displaying a filter text field or a filter drop-down menu wherein a user may enter a filter string, the filter string employable to filter the indicators of the first and second pluralities of scenes,

g. wherein the indicators of the second plurality of scenes are only displayed for the highlighted one of the first plurality, and such that the indicators of the first and second pluralities of scenes constitute intersecting carousel type user interfaces, such that, by swiping actions, an indicator may be placed at an intersection of the intersecting carousel type user interfaces, and such that the highlighting one of the first plurality causes the highlighted indicator to be placed at the intersection.

26. A device for editing video, comprising:

a. a user interface module configured to display multiple scenes for review, to receive a selection of a scene from the multiple scenes for review, to highlight the selected scene, and to display multiple context scenes related to the selected scene, the multiple context scenes determined at least in part by analysis of data corresponding to the multiple scenes for review, at least one of the context scenes being a scene that comes before or after the selected scene in a video sequence of scenes; and

b. a tools module configured to provide user modification of the selected scene, and to calculate a response of the selected scene to the user modification,

c. a history module configured to, upon activation of the selected scene, display indications of one or more versions of the selected scene,

d. wherein the response of the selected scene is transmitted to the user interface module for display on the device;

e. wherein the user interface module is further configured to display indicators of the multiple scenes for review as a first plurality of scenes, and wherein the user interface module is further configured to display indicators of the multiple context scenes for review as a second plurality of scenes, and wherein the second plurality of scenes are only displayed for the highlighted scene, and such that the indicators of the first and second pluralities of scenes constitute intersecting carousel type user interfaces, such that, by swiping actions, an indicator may be placed at an intersection of the intersecting carousel type user interfaces, and such that the highlighted indicator is displayed at the intersection.

27. The device of claim 26, further comprising a communications module configured to receive files corresponding to the multiple scenes and the multiple context scenes.

28. The device of claim 27, wherein the communications module is further configured to share data about one or more of the multiple scenes with other devices.

29. The device of claim 28, wherein the shared data corresponds to the multiple scenes and the multiple context scenes as well as annotations, adjustments, or user audio or video comments.

30. The device of claim 29, further comprising a control module, the control module configured to allow only one device at a time to exert control over the reviewing session, wherein the exertion of control constitutes the ability to annotate, adjust, or change a selected image.

31. The device of claim 26, wherein the tools module is configured to annotate or adjust the selected scene.