Video event capture, storage and processing method and apparatus

• US 8,934,627 B2
• Filed: 06/24/2002
• Issued: 01/13/2015
• Est. Priority Date: 06/25/2001
• Status: Active Grant

• Current Assignee: Nytell Software LLC (Intellectual Ventures LLC)
• Original Assignee: Aprolase Development Co LLC (Intellectual Ventures LLC)
• Inventors: Carlson, Randolph S.
• Primary Examiner(s): LANIER, BENJAMIN E
• Application Number:
  US10/178,390
• Publication Number:
  US 20030009773A1
• Time in Patent Office: 4,586 Days
• Field of Search: None
• US Class Current: 380/200
• CPC Class Codes: G06F 21/62 Protecting access to data via a platform, e.g. using keys or access control rules
• CPC Class Codes: G11B 2220/2562 DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: H04N 1/00127 Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
• CPC Class Codes: H04N 1/00132 in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
• CPC Class Codes: H04N 1/00137 Transmission
• CPC Class Codes: H04N 1/00161 Viewing or previewing
• CPC Class Codes: H04N 1/00167 Processing or editing H04N1/00196 - H04N1/00201 take precedence
• CPC Class Codes: H04N 1/00188 Printing, e.g. prints or reprints H04N1/0019, H04N1/00196 take precedence
• CPC Class Codes: H04N 1/00291 with receiver circuitry television receiver circuitry per se H04N5/44
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/440236 by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/63345 by transmitting keys key distribution for secret or secure communication H04L9/08; network support of key management H04L63/06
• CPC Class Codes: H04N 21/63775 for uploading keys, e.g. for a client to communicate its public key to the server key management H04L9/08; network support of key management H04L63/06
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 2201/3242 of processing required or performed, e.g. for reproduction or before recording H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/3274 : Storage or retrieval of prestored additional information
• CPC Class Codes: H04N 5/4448 : for frame-grabbing

Abstract

Generating a still image from a sequence of video frames comprises the steps of receiving a sequence of video frames and storing a predetermined number of the sequence of video frames temporally adjacent to an user initiated capture event, the predetermined number of frames being defined as a cliplet. Video capture is performed using cliplets, which are short video segments, preferably in compressed data format. A crop-and-process instruction is added to the cliplet. All processing, handling or storage of the data is cliplet based. Editing instructions are stored with the cliplet allowing editing to be performed by a user at one resolution and then re-performed at a higher resolution at a server where it is printed. Modified reprints of an image can be obtained without resending the images and adequate storage for the cliplets can be assured. Encryption of the cliplets during transmission and storage is facilitated by cliplet-based processing.

Claims

1. An apparatus comprising:

a video viewer configured to display a first sequence of video frames; and

a buffer configured to store a video including a temporally adjacent sequence of video frames from the first sequence of video frames;

wherein the video viewer, in response to a command from a user to capture a still image from the first sequence of video frames, is further configured to create a data structure including the video and an editing instruction identifying a particular frame from the temporally adjacent sequence of video frames; and

wherein the command to capture a still image corresponds to a frame being currently displayed by the video viewer when the command is received from the user, and wherein the temporally adjacent sequence of video frames includes a video frame preceding the video frame being currently displayed by the video viewer when the command is received from the user and a video frame following the video frame being currently displayed by the video viewer when the command is received.

2. The apparatus of claim 1, wherein the video comprises at least one tenth of a second of display time.

3. The apparatus of claim 1, wherein the still image is configured to be captured from the particular frame, and wherein the editing instruction describes the particular frame.

4. The apparatus of claim 3, wherein the editing instruction relates to a selected portion of the particular frame.

5. The apparatus of claim 3, wherein the editing instruction comprises a frame number corresponding to the particular frame.

6. The apparatus of claim 3, wherein the editing instruction comprises setting information related to at least one of crop dimensions, a crop location, an up-sample ratio, a sharpness parameter, a persistence parameter, or the number of frames to be processed to form a still image.

7. The apparatus of claim 1, wherein the video viewer and the buffer are included in a computer.

8. The apparatus of claim 7, wherein the video viewer comprises the buffer.

9. The apparatus of claim 1, wherein the first sequence of video frames is configured to be communicated to the video viewer in a compressed data format, and wherein the video viewer is further configured to store the data structure in the buffer in the compressed data format.

10. The apparatus of claim 1, wherein the data structure is a cliplet.

11. The apparatus of claim 10, wherein the video viewer is further configured to transport, store, archive, or retrieve video frames as cliplets.

12. The apparatus of claim 1, wherein the editing instruction comprises a revised instruction indicating a user'"'"'s revised editing parameter selections, and wherein the revised instruction is configured to replace a default instruction.

13. The apparatus of claim 1, wherein the video viewer is further configured to process the data structure at a first resolution and to transmit the data structure to a second apparatus, and wherein the second apparatus is configured to process the data structure, according to the editing instruction, at a second resolution that is higher than the first resolution.

14. The apparatus of claim 13, wherein the data structure comprises a second editing instruction configured to generate a second still image.

15. The apparatus of claim 1, wherein the video viewer is further configured to generate a blank data structure to reserve data storage space.

16. The apparatus of claim 15, wherein the temporal sequence of video frames and the editing instruction are saved in the blank data structure.

17. The apparatus of claim 16, wherein the blank data structure comprises pseudo-random data that is combined with the temporal sequence of video frames and the editing instruction.

18. The apparatus of claim 17, wherein the apparatus is configured to exchange an encryption key with a server during generation of the blank data structure.

19. The apparatus of claim 17, wherein the apparatus is configured to exchange an encryption key with a server during a secure communication session that is different from a communication session in which an encrypted data structure is communicated from the apparatus to the server.

20. The apparatus of claim 1, wherein the data structure further comprises a unique identifier configured to communicate to a server an association between the data structure and a user or a client computer.

21. The apparatus of claim 1, wherein the buffer is further configured to encrypt the data structure.

52. The apparatus of claim 1, wherein the temporally adjacent sequence of video frames comprises a video frame immediately temporally preceding the video frame being currently displayed by the video viewer when the command is received and a video frame immediately temporally following the video frame being currently displayed by the video viewer when the command is received.

22. A method comprising:

displaying a first sequence of video frames using a video viewer;

storing, in a buffer, a video including a temporally adjacent sequence of video frames from the first sequence of video frames;

receiving a command from a user to capture a still image from the first sequence of video frames; and

in response to the command from the user to capture the still image, creating a data structure, using the video viewer, including the video and an editing instruction identifying a particular frame from the temporally adjacent sequence of video frames;

wherein the command to capture a still image corresponds to a frame being currently displayed by the video viewer when the command is received, and wherein the temporally adjacent sequence of video frames includes a prior video frame preceding the video frame being currently displayed by the video viewer when the command is received and a subsequent video frame following the video frame being currently displayed by the video viewer when the command is received.

23. The method of claim 22, wherein the video comprises at least one tenth of a second of display time.

24. The method of claim 22, wherein the still image is configured to be captured from the particular frame, and wherein the editing instruction describes the particular frame.

25. The method of claim 24, wherein the editing instruction relates to a selected portion of the particular frame.

26. The method of claim 24, wherein the editing instruction comprises a frame number corresponding to the particular frame.

27. The method of claim 24, wherein the editing instruction comprises setting information related to at least one of crop dimensions, a crop location, an up-sample ratio, a sharpness parameter, a persistence parameter, or the number of frames to be processed to form a still image.

28. The method of claim 22, wherein the video viewer and the buffer are included in a computer.

29. The method of claim 22, further comprising:

receiving, at the video viewer, the first sequence of video frames in a compressed data format; and

storing the data structure in the buffer in the compressed data format.

30. The method of claim 22, wherein the data structure is a cliplet.

31. The method of claim 30, further comprising transporting, storing, archiving, or retrieving video frames as cliplets using the video viewer.

32. The method of claim 22, wherein the editing instruction comprises a revised instruction indicating a user'"'"'s revised editing parameter selections, and wherein the revised instruction replaces a default instruction.

33. The method of claim 22, further comprising:

processing the data structure at a first resolution; and

transmitting the data structure to a second apparatus configured to process the data structure, according to the editing instruction, at a second resolution that is higher than the first resolution.

34. The method of claim 33, wherein the data structure comprises a second editing instruction configured to generate a second still image.

35. The method of claim 22, further comprising generating, via the video viewer, a blank data structure to reserve data storage space.

36. The method of claim 35, further comprising saving, via the video viewer, the temporal sequence of video frames and the editing instruction in the blank data structure.

37. The method of claim 36, wherein the blank data structure comprises pseudo-random data that is combined with the temporal sequence of video frames and the editing instruction.

38. The method of claim 37, further comprising exchanging an encryption key with a server during generation of the blank data structure.

39. The method of claim 37, further comprising exchanging an encryption key with a server during a secure communication session that is different from a communication session in which an encrypted data structure is communicated to the server.

40. The method of claim 22, wherein the data structure comprises a unique identifier configured to indicate to a server an association between the data structure and a user or a client computer.

41. The method of claim 22, further comprising encrypting the data structure at the buffer.

53. The method of claim 22, wherein the command to capture a still image corresponds to a frame being currently displayed by the video viewer when the command is received, and wherein the temporal temporally adjacent sequence of video frames comprises a prior video frame immediately temporally preceding the video frame being currently displayed by the video viewer when the command is received and a subsequent video frame immediately temporally following the video frame being currently displayed by the video viewer when the command is received.

42. A method comprising:

defining, using a buffer, a video including a temporally adjacent sequence of video images;

capturing upon receipt of a command from a user, using a video viewer, an image by selecting a video image from the temporally adjacent sequence of video images; and

generating, using the video viewer, a data structure, wherein the data structure includes the video and an editing instruction associated with the captured image that defines processing parameters configured to render a still image corresponding to the captured image;

wherein the temporally adjacent sequence of video images includes a prior video image preceding the selected video image and a subsequent video image following the selected video image.

43. The method of claim 42, wherein the data structure is a cliplet.

44. The method of claim 42, wherein the editing instruction comprises an identification of the captured image and spatial processing information.

45. The method of claim 42, further comprising storing, archiving, processing, or communicating the data structure as a single unit of information in a computer system.

46. A non-transitory computer-readable medium having stored thereon, computer-executable instructions that, if executed by a computing device, cause the computing device to perform a method comprising:

displaying, using a video viewer, a first sequence of video frames;

storing a video including a temporally adjacent sequence of video frames from the first sequence of video frames;

receiving a command from a user to capture a still image from the first sequence of video frames; and

in response to said receiving a command from a user to capture a still image, creating a data structure including the video and an editing instruction identifying a particular frame from the temporally adjacent sequence of video frames;

wherein the command to capture a still image corresponds to a frame being currently displayed by the video viewer when the command is received, and wherein the temporally adjacent sequence of video frames includes a prior video frame preceding the frame being currently displayed by the video viewer when the command is received and a subsequent video frame following the frame being currently displayed by the video viewer when the command is received.

47. The computer-readable medium of claim 46, wherein the data structure is a cliplet.

48. The computer-readable medium of claim 46, wherein the still image is captured from the particular frame, and wherein the editing instruction describes the particular frame.

49. The computer-readable medium of claim 47, wherein the editing instruction relates to a selected portion of the particular frame.

50. The computer-readable medium of claim 47, wherein the editing instruction comprises a frame number corresponding to the particular frame.

51. The computer-readable medium of claim 47, wherein the editing instruction comprises setting information related to at least one of crop dimensions, a crop location, an up-sample ratio, a sharpness parameter, a persistence parameter, and the number of frames to be processed to form a still image.