Enhanced video/still image correlation

• US 20060274157A1
• Filed: 05/23/2006
• Published: 12/07/2006
• Est. Priority Date: 06/02/2005
• Status: Active Grant

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Searete LLC (Intellectual Ventures LLC)
• Inventors: Lord, Robert W., Levien, Royce A., Malamud, Mark A., Rinaldo, John D. Jr.
• Granted Patent: US 7,782,365 B2
• Time in Patent Office: Days
• US Class Current: 348/220.100
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 1/212 Motion video recording combined with still video recording television signal recording H04N5/76
• CPC Class Codes: H04N 2101/00 Still video cameras
• CPC Class Codes: H04N 2201/3242 of processing required or performed, e.g. for reproduction or before recording H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/3246 of data relating to permitted access or usage, e.g. level of access or usage parameters for digital rights management [DRM] related to still images
• CPC Class Codes: H04N 2201/3252 Image capture parameters, e.g. resolution, illumination conditions, orientation of the image capture device H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/3267 of motion picture signals, e.g. video clip
• CPC Class Codes: H04N 2201/3274 Storage or retrieval of prestored additional information
• CPC Class Codes: H04N 23/617 Upgrading or updating of programs or applications for camera control
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

A technique processes captured data on a device, wherein selected captured data of a given quality resolution is transferred via a communication link to a separate storage location for future availability. A storage protocol may include various storage organization categories. A possible aspect may provide an identifier record to enable future accessibility to selected captured data by one or more authorized parties or approved devices or authorized recipients. In some embodiments the captured data may include both a video data stream and one or more still image frames having different quality characteristics and/or formats. Initial and ongoing coordination as well as correlation may be facilitated between video and still image data derived from related fields of view.

Claims

1. A method of image capture correlation comprising:

creating a video data stream derived from a field of view of a video capture component;

capturing one or more still image frames derived from a related field of view of a still image capture component, wherein the one or more still image frames include different quality characteristics compared to the video data stream; and

providing a cross-reference association between the video data stream and the one or more still image frames, which cross-reference association facilitates future accessibility between a portion of the video data stream and a particular correlated still image frame.

2. The method of claim 1 wherein said capturing one or more still image frames includes:

capturing one or more still image frames having different quality characteristics generated as a result of a given quality capability of the still image capture device.

3. The method of claim 1 wherein said capturing one or more still image frames includes:

capturing one or more still image frames having different quality characteristics generated as a result of a different format feature generated by the still image capture component.

4. The method of claim 1 wherein said providing the cross-reference association includes:

establishing the cross-reference association contemporaneously with creating the video data stream.

5. The method of claim 1 wherein said providing the cross-reference association includes:

establishing the cross-reference association subsequent to creating the video data stream.

6. The method of claim 1 wherein said providing the cross-reference association includes:

establishing the cross-reference association contemporaneously with capturing the correlated still image frame.

7. The method of claim 1 wherein said providing the cross-reference association includes:

establishing the cross-reference association subsequent to capturing the correlated still image frame.

8. The method of claim 1 wherein said providing the cross-reference association includes:

coordinating the creating of the video data stream with the capturing one or more still image frames to facilitate establishing an identifier tag as at least a partial basis for implementing the cross-reference association.

9. The method of claim 8 wherein said establishing the identifier tag includes:

establishing the identifier tag that identifies at least one video frame created at approximately the same time as the capturing of the correlated still image frame.

10. The method of claim 8 wherein said establishing the identifier tag includes establishing one or more of the following types of identifier tags:

time stamp, date stamp, background, view location, project name, topic, client, video component, still component, component specification, storage media, storage location, component operator, participant, indicia ID, sequence numeral, thumbnail link, index listing, acronym, abbreviation, pointer link, hyper-link, icon, and barcode.

11. The method of claim 8 wherein said establishing the identifier tag includes:

establishing a default identifier tag that cannot be altered.

12. The method of claim 8 wherein said establishing the identifier tag includes:

enabling user selection of the identifier tag.

13. The method of claim 8 further comprising:

enabling programmed or automated selection of the identifier tag.

14. The method of claim 1 wherein said providing the cross-reference association includes:

incorporating a cross-reference video identifier with a specified stored portion of the video data stream to facilitate on or more of the following types of future accessibility;

view, display, forward, create thumbnail, retrieve, copy, edit, change resolution, increase resolution, decrease resolution, change format, combine images, distribute, delete, print, collate, restricted access, access security, modify identifier, delete identifier, and add identifier.

15. The method of claim 14 further comprising:

enabling accessibility to the specified stored portion of the video data stream in response to a communication that includes the cross-reference video identifier.

16. The method of claim 14 further comprising:

storing the specified stored portion of the video data stream in localized media integrated with or operably coupled to the video capture component.

17. The method of claim 14 further comprising:

storing the specified stored portion of the video data stream in removable media that can be transported separate and apart from the video capture component.

18. The method of claim 14 further comprising:

storing the specified stored portion of the video data stream in a remote storage location separate and apart from the video capture component.

19. The method of claim 18 wherein said storing the specified stored portion of the video data stream in the remote storage location includes;

storing the specified stored portion in the remote storage location owned or operated by a third party.

20. The method of claim 1 wherein said providing the cross-reference association includes:

incorporating a cross-reference still image identifier with one or more given still image frames to facilitate one or more of the following types of future accessibility;

view, display, forward, create thumbnail, retrieve, copy, edit, change resolution, increase resolution, decrease resolution, change format, combine images, distribute, delete, print, collate, restricted access, access security, modify identifier, delete identifier, and add identifier.

21. The method of claim 20 further comprising:

enabling accessibility to the given still image frames in response to a communication that includes the cross-reference still image identifier.

22. The method of claim 20 further comprising:

storing the given still image frames in localized media integrated with or operably coupled to the still image capture component.

23. The method of claim 20 further comprising:

storing the given still image frames in removable media that can be transported separate and apart from the still image capture component.

24. The method of claim 20 further comprising:

storing the given still image frames in a remote storage location separate and apart from the still image capture component.

25. The method of claim 24 wherein said storing the given still image frames in the remote storage location includes;

storing the given still image frames in the remote storage location owned or operated by a third party.

26. The method of claim 1 further comprising:

storing the one or more still image frames as a digital object distinct from a stored version of the video data stream.

27. The method of claim 1 further comprising:

storing the one or more still image frames as a digital object associated with a stored version of the video data stream.

28. The method of claim 1 further comprising:

incorporating in the still image capture component one or more quality capabilities that are different from specified quality parameters of the video capture component.

29. The method of claim 28 further comprising:

incorporating one or more of the following different quality capabilities in the still image capture component;

color balance, white balance, color space, depth of field, pixel capture resolution, pixel storage resolution, capture quality, storage quality, gray scale, ambient light sensor, infra-red illumination, flash illumination, aperture opening, focal point, filter, shutter speed, automated shutter, manual shutter, still frame frequency, preview display, post-capture display, high Q storage media, low Q storage media, removable storage media, programmed quality attribute, automated quality attribute, user-selected quality attribute, ownership right, transfer right, volatile memory, permanent memory, post-capture editing, and meta-data.

30. The method of claim 1 further comprising:

enabling a programmed or automated coordination of the related fields of view of the video capture component and the still image capture component.

31. The method of claim 30 further comprising:

allowing a user-actuated override to change the programmed or automated coordination of the related fields of view.

32. The method of claim 1 further comprising:

enabling user-actuated coordination of the related fields of view of the video capture component and the still image capture component.

33. The method of claim 1 wherein said capturing the one or more still image frames includes:

allowing selection of a close-up zoom field of view for the still image capture component without causing a same close-up field of view for the video capture component.

34. The method of claim 1 wherein said capturing one or more still image frames includes:

allowing selection of a distant zoom field of view for the still image capture component without causing a same distant field of view for the video capture component.

35. The method of claim 1 wherein said capturing one or more still image frames includes:

allowing selection of an enlarged or diminished field of view for the still image capture component without causing a same enlarged or diminished field of view for the video capture component.

36. The method of claim 1 wherein said capturing one or more still image frames includes:

providing a still mode format having one or more of the following type of different visual elements as compared to the video mode format;

aspect ratio, color space, color value, color intensity, image intensity, resolution, pixel density, dynamic range, and pixel depth.

37. The method of claim 1 wherein said capturing one or more still image frames includes:

providing a shutter speed interval for the still image capture component that is different from a concurrent frame frequency interval for the video capture component.

38. The method of claim 1 further comprising:

activating an ancillary module approximately concurrently with capturing the one or more still image frames.

39. The method of claim 38 wherein said activating the ancillary module includes:

deactivating the video capture component during an activation interval for the ancillary module.

40. The method of claim 1 further comprising:

activating an ancillary module prior to capturing the one or more still image frames.

41. The method of claim 40 further comprising:

initiating the capturing of one or more still image frames in response to an output of the ancillary module.

42. The method of claim 41 further comprising:

initiating the capturing of one or more still image frames in response to field of view information detected or sensed by the ancillary module.

43. The method of claim 1 further comprising:

selectively activating one or more of the following features associated with the still image capture component in response to an output of an ancillary module;

zoom in, zoom out, close-up, distant, fixed field of view, variable field of view, wide angle view, narrow angle view, diminished field of view, add filter, omit filter, shutter speed, exposure parameter, supplemental illumination, higher quality image, lower quality image, higher resolution capture, higher resolution storage, lower resolution capture, lower resolution storage, ID indicia, wireless transfer, hardcopy output, and thumbnail display.

44. The method of claim 1 further comprising:

enabling display of a thumbnail exemplar that incorporates a cross-reference still image identifier.

45. The method of claim 1 further comprising:

enabling display of a thumbnail exemplar that incorporates a cross-reference video identifier.

46. The method of claim 1 further comprising:

incorporating a cross-reference identifier with the display of thumbnail exemplars to provide a reference link to both a portion of a stored video data stream and a stored correlated still image frame.

47. The method of claim 1 wherein said activating the still image component includes:

activating an ancillary component prior to or concurrently with activating a shutter to assist in generating the one or more still image frames.

48. The method of claim 47 wherein said activating the ancillary component includes activating one or more of the following type of ancillary components:

flash illuminator, infrared illuminator, ultraviolet illuminator, light meter, exposure controller, time stamp, date stamp, ID indicia, zoom lens actuator, sensor, monitor, and detector.

49-63. -63. (canceled)

64. An image correlation system comprising:

video module with specified quality parameters for providing a video data stream derived from a field of view;

a still image module with given quality capabilities for providing one or more still image frames derived from a related field of view, which still image frames include different quality characteristics compared to the video data stream;

data record means operatively coupled with said video module and with said still image module to store selected versions of the video data stream and the still image frames; and

control means for coordinating the video module with the still image module to establish a cross-reference association between the video data stream and the one or more still image frames to facilitate future accessibility to a portion of the selected version of video data stream and/or to a particular selected version of a correlated still image frame.

65. The system of claim 64 wherein said video module includes a video capture component for creating the video data stream derived from the field of view.

66. The system of claim 65 wherein said video module further includes one or more auxiliary features for helping to provide an enhanced video data stream derived from the field of view of the video capture component.

67. The system of claim 65 wherein said video module further includes one or more ancillary components for providing input information to the control means based on a monitored or sensed or detected event in the field of view of the video capture component.

68. The system of claim 65 wherein said video capture component is capable of activation by one or more of the following type of events:

ancillary module output, monitored field of view participant, monitored field of view activity, sensed field of view condition, user selection, programmed selection, automated selection, and temporal schedule

69. The system of claim 64 wherein said still image module includes a still image capture component for initiating the capture of the one or more still image frames derived from the related field of view.

70. The system of claim 69 wherein said still image module further includes one or more auxiliary features for helping to provide one or more enhanced still image frames derived from the related field of view of the still image capture component

71. The system of claim 69 wherein said still image module further includes one or more ancillary components for providing input information to the control means based on a monitored or sensed or detected event in the related field of view of the still image capture component.

72. The system of claim 69 wherein said still image capture component includes capability of activation by one or more of the following type of events:

ancillary module output, monitored field of view participant, monitored field of view activity, sensed field of view condition, user selection, programmed selection, automated selection, and temporal schedule.

73. The system of claim 64 wherein said video module includes a video capture component and said still image module includes a still image capture component, and wherein said control means is configured for implementing user coordination or programmed coordination or automated coordination of the related fields of view of the video capture component and the still image capture component.

74. A computer program product having instructions for executing a process that comprises:

creating a video data stream derived from a field of view of a video capture component having one or more specified quality parameters;

capturing of one or more still image frames derived from a related field of view of a still image capture component having given quality capabilities;

generating a stored version of the video data stream and of the captured still image frames, wherein the one or more still image frames include one or more different quality characteristics compared to the video data stream;

providing a cross-reference association that facilitates coordinated accessibility between a portion of the video data stream and a particular correlated still image frame; and

wherein the process instructions are encoded on signal or storage media.

75. The computer program product of claim 74 wherein the process further includes:

enabling the cross-reference association to facilitate one or more of the following types of future accessibility to the video data stream and/or the one or more still image frames;

view, display, forward, create thumbnail, retrieve, copy, edit, change resolution, increase resolution, decrease resolution, change format, combine images, distribute, delete, print, collate, restricted access, access security, modify cross-reference identifier, delete cross-reference identifier, and add cross-reference identifier.

76. The computer program product of claim 74 wherein the process further includes:

establishing the cross-reference association contemporaneously with creating the video data stream.

77. The computer program product of claim 74 wherein the process further includes:

establishing the cross-reference association contemporaneously with capturing the one or more still image frames.