Systems and methods for transferring a clip of video data to a user facility

• US 9,838,668 B2
• Filed: 02/14/2017
• Issued: 12/05/2017
• Est. Priority Date: 06/17/2014
• Status: Active Grant

• Current Assignee: Actality, Inc
• Original Assignee: Actality, Inc
• Inventors: Prechtl, Eric F.
• Primary Examiner(s): Beck, Leron
• Application Number:
  US15/432,114
• Publication Number:
  US 20170155888A1
• Time in Patent Office: 294 Days
• Field of Search: 348 48
• CPC Class Codes: G03B 17/561 Support related camera accessories
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: G03B 37/04 with cameras or projectors providing touching or overlapping fields of view
• CPC Class Codes: G06T 7/593 from stereo images
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/20 Image signal generators
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 2213/001 Constructional or mechanical details
• CPC Class Codes: H04N 23/50 Constructional details
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/41 Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors

Abstract

An imaging system and methods for using an imaging system where the operator is able to variably adjust the parallax distance for enhanced stereo performance are disclosed. In addition, by coordinating the parallax distance with the optical settings of the camera, artificial 3D experiences can be created that give a user the perception of observing a scene from a distance different than that actually employed. The imaging system may also include a plurality of stereo camera supersets, wherein a first one or more stereo camera supersets are positioned at a different height relative to a first stereo camera superset. Novel specific uses of the camera system, such as in capturing events of interest are described. Useful techniques for extracting or encoding wide field of view images from memory are also disclosed.

Claims

1. A computer-implemented method of transferring a clip of video data associated with an event having been observed by a user to a facility designated by the user, the method comprising:

storing, in a buffer system coupled to a central processing node, video data from a camera system including at least one wide field-of-view camera;

receiving, at the central processing node, a request message from an application executing on a device of the user for transfer of the clip of video data, wherein the request message specifies performance parameters for the requested clip including identification of a set of the wide field-of-view cameras from which to take the clip, the set having at least one member, a start time of the clip, an end time or length of the clip, and horizontal and vertical field of view of the viewing frustum, such performance parameters having been graphically selected by the user via the application using a graphical selection user interface;

responsive to the request message, retrieving, by the central processing node, video data associated with the identified set of cameras from the buffer system based on the performance parameters;

processing the retrieved video data by the central processing node based on the performance parameters to produce the clip, such processing including extracting from the retrieved video data a set of video data in accordance with the specified horizontal and vertical field of view and producing the clip from the extracted video data; and

transmitting the clip including the processed video data to the designated facility.

2. The method of claim 1, further comprising:

providing, by the central processing node to the device of the user, a set of images captured by the camera system for presentation on the graphical selection user interface.

3. The method of claim 1, wherein:

the performance parameters identify a plurality of cameras;

retrieving includes retrieving video data associated with the plurality of cameras; and

processing includes at least one of stitching or blending of the video data associated with the plurality of cameras.

4. The method of claim 1, wherein at least one of the wide field-of-view cameras is a stereoscopic wide field-of-view camera.

5. The method of claim 1, wherein the performance parameters include at least one of parallax distance or zoom factor, and wherein the extracted video data included in the clip is based on the specified parallax distance or zoom factor.

6. The method of claim 1, wherein the performance parameters include output video quality settings including at least one of resolution, frame-rate, compression quality, or video format, and wherein the clip is formatted according to the specified output video quality settings.

7. The method of claim 1, wherein processing includes 3D analysis to analyze mechanical movement of at least one participant in the event.

8. The method of claim 1, wherein processing includes appending the clip with metadata including at least one of an event name, a data, a time, GPS coordinates, or ownership information.

9. The method of claim 1, further comprising:

transmitting, by the central processing node, a reply message to the application executing on the device of the user specifying a condition for the requested video clip based on the performance parameters, wherein the central processing node only transmits the clip to the designated facility after the condition is met.

10. The method of claim 1, wherein the designated facility is separate from the device of the user.

11. A computer-implemented method of requesting a clip of video data associated with an event having been observed by a user to a facility designated by a user, the method comprising:

a software application executing on a device of the user, wherein the application sends a request to a central processing node in communication with and in control of a camera system having at least one wide field-of-view camera that captured video of the event;

wherein video data from the camera system is stored in a buffer system coupled to the central processing node; and

wherein the application provides a graphical user interface on a display of the device that allows the user to graphically select performance parameters for the requested clip including identification of a set of wide field-of-view cameras from which to take the clip, the set having at least one member, a start time of the clip, an end time or length of the clip, and horizontal and vertical field of view of the viewing frustum;

the request message including the graphically-selected performance parameters, wherein the request induces the central processing node to retrieve video data associated with the identified set of cameras from the buffer system based on the performance parameters, process the retrieved video data from the buffer system based on the performance parameters to produce the clip, such processing including extracting from the retrieved video data a set of video data in accordance with the specified horizontal and vertical field of view and producing the clip from the extracted video data, and transmit the clip including the processed video data to the designated facility.

12. The method of claim 11, wherein the graphical user interface includes presentation of a set of images captured by the camera system.

13. The method of claim 11, wherein the performance parameters identify a plurality of cameras, and wherein the clip includes at least one of stitched or blended video data associated with the plurality of cameras.

14. The method of claim 11, wherein at least one of the wide field-of-view cameras is a stereoscopic wide field-of-view camera.

15. The method of claim 11, wherein the performance parameters include at least one of parallax distance or zoom factor, and wherein the extracted video data included in the clip is based on the specified parallax distance or zoom factor.

16. The method of claim 11, wherein the performance parameters include output video quality settings including at least one of resolution, frame-rate, compression quality, or video format, and wherein the clip is formatted according to the specified output video quality settings.

17. The method of claim 11, wherein the graphical user interface allows the user to pre-specify the performance parameters for the clip, and wherein the graphical user interface allows the user to request the clip using a one-button selection mechanism.

18. The method of claim 11, wherein the request message is transmitted wirelessly from the application executing on the device of the user to the central processing node.

19. The method of claim 11, wherein the designated facility is separate from the device of the user.

20. A system for transferring a clip of video data associated with an event having been observed by a user to a facility designated by a user, the system comprising:

a central processing node;

a camera system including at least one wide field-of-view camera; and

a buffer system coupled to the central processing node and storing video data from the camera system, wherein the central processing node is configured to;

receive a request message from an application executing on a device of the user for transfer of the clip of video data, wherein the request message specifies performance parameters for the requested clip including identification of a set of the wide field-of-view cameras from which to take the clip, the set having at least one member, a start time of the clip, an end time or length of the clip, and horizontal and vertical field of view of the viewing frustum, such performance parameters having been graphically selected by the user via the application using a graphical selection user interface;

retrieve, in response to the request message, video data associated with the identified set of cameras from the buffer system based on the performance parameters;

process the retrieved video data based on the performance parameters to produce the clip, such processing including extracting from the retrieved video data a set of video data in accordance with the specified horizontal and vertical field of view and producing the clip from the extracted video data; and

transmit the clip including the processed video data to the designated facility.