Video production sharing apparatus and method

• US 10,009,596 B2
• Filed: 09/12/2014
• Issued: 06/26/2018
• Est. Priority Date: 09/13/2013
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Jayaram, Sankar, Singh, Vikas K., Kale, Ritesh, Harrison, John, DeChenne, Charles, Jayaram, Uma
• Primary Examiner(s): Gee, Alexander
• Application Number:
  US14/485,569
• Publication Number:
  US 20150082364A1
• Time in Patent Office: 1,383 Days
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/282 for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 21/231 Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A video production sharing apparatus is provided with a first computer having a processor, memory, and an input device, the memory having programs stored therein, the programs implemented through the processor and designed to cause the processor to: 1) access at least one video stream, 2) manipulate viewing perspective of the at least one video stream with the input device of the first computer to generate an individualized video, and 3) transfer a data file of user inputs from the input device used to manipulate the at least one video stream to create the individualized video that describes the individualized video of the at least one video stream. A method is also provided.

Claims

1. A video production sharing apparatus, comprising:

a processor, and a memory, the memory having programs stored therein, the programs executed by the processor to cause the processor to;

access a panoramic video of a scene captured by a plurality of video cameras, each of the video cameras to capture a portion of the panoramic video from a different viewpoint;

manipulate a viewing perspective of the panoramic video with the input device controlled by a first user to render an individualized video, the manipulation of the viewing perspective comprising at least one of pan, tilt, zoom and change in temporal viewing direction and/or speed of playback of the panoramic video;

record the manipulation of the viewing perspective as metadata within a metadata structure, the metadata structure comprising interpretable code specifying at least a portion of the manipulation of the viewing perspective and usable to reproduce the individualized video, the metadata including control data to indicate at least one of a start time, end time, duration, playback speed, and camera control events including one or more of pan, tilt, and zoom; and

transfer the metadata structure to a server accessible to at least one client of a second user, the client to execute program code to interpret the metadata and reproduce the individualized video by retrieving the panoramic video from a network location specified in the metadata or in an external link and applying the manipulation of the viewing perspective of the panoramic video in accordance with the metadata.

3. The apparatus of claim 1 wherein the metadata structure comprises a computer-readable file containing text specifying the metadata.

4. The apparatus of claim 1 wherein the server comprises a social networking site on which the first user has an account, the second user registered as a friend of the first user on the social networking site and accessing the metadata structure by logging in to the social networking site.

5. The apparatus of claim 4, wherein the social networking site comprises a storage device to store the metadata structure and associate the metadata structure with the first user'"'"'s account.

6. The apparatus of claim 1, wherein the panoramic video comprises a plurality of simultaneous video streams of the scene, each one of the simultaneous video streams captured from a unique viewing perspective by each of a plurality of uniquely positioned video cameras.

7. The apparatus of claim 1, wherein the plurality of video cameras are distributed about a location each having a unique viewing perspective.

8. The apparatus of claim 1, further comprising an Internet cloud-based data store configured to store the metadata structure.

22. The apparatus of claim 7, wherein the processor is configured to:

access each video stream from each camera, manipulate the viewing perspective within each video stream with the input device to generate the individualized video generated by navigation within the video stream of each camera.

23. The apparatus of claim 22, wherein the plurality of video streams enable one or more users via at least one computer to perform both intra-camera navigation of each individual video stream and inter-camera navigation between respective video streams from each camera.

2. The apparatus of 1 wherein the client of the second user comprises a processor, memory, and an output device, the memory having programs stored therein, the programs implemented through the processor and designed to cause the processor to:

receive the metadata structure and panoramic video, generate for viewing at the client of the second user the individualized video by manipulating the rendition of the panoramic video by interpreting the metadata structure, and the individualized video to be rendered on the output device of the client of the second user.

9. A method for sharing a video production, comprising:

accessing a panoramic video of a scene captured by a plurality of video cameras, each of the video cameras to capture a portion of the panoramic video from a different viewpoint;

manipulating a viewing perspective of the panoramic video with an input device controlled by a first user to render an individualized video, the manipulation of the viewing perspective comprising at least one of pan, tilt, zoom and change in temporal viewing direction and/or speed of playback of the panoramic video;

capturing the manipulation of the viewing perspective as metadata within a metadata structure, the metadata structure comprising interpretable code specifying at least a portion of the manipulation of the viewing perspective and usable to reproduce the individualized video, the metadata including control data to indicate at least one of a start time, end time, duration, playback speed, and camera control events including one or more of pan, tilt, and zoom; and

transferring the metadata structure to a server accessible to at least one client of a second user, the client to execute program code to interpret the metadata and reproduce the individualized video by retrieving the panoramic video from a network location specified in the metadata or in an external link and applying the manipulation of the viewing perspective of the panoramic video in accordance with the metadata.

10. The method of claim 9 wherein the metadata structure comprises a computer-readable file containing text specifying the metadata.

11. The method of claim 10 wherein the program code to interpret the metadata comprises an application or browser plug-in executed on the client of the second user.

12. The method of claim 11, further comprising interpreting the text of the computer-readable file to reproduce the individualized video.

13. The method of claim 12, further comprising rendering the individualized video on an output device of the at least one computer.

14. The method of claim 9, wherein accessing comprises retrieving the panoramic video at a computer.

15. The method of claim 14, further comprising storing the panoramic video on the computer.

16. The method of claim 9, wherein the panoramic video stream comprises a plurality of video streams, each video stream captured from a different one of the video cameras, and manipulating viewing perspective comprises creating a viewing perspective using one or more of the plurality of video streams.

17. The method of claim 16, wherein a viewing perspective is generated by user input to manipulate one or more of the video streams to capture an image sub-space within an image space of each of the plurality of video streams.

18. The method of claim 17, wherein each image sub-space gives the second user of the client the feeling of controlling camera pan, tilt, and zoom in a digital space.

19. The method of claim 9, wherein manipulating the viewing perspective comprises at least one of pan, tilt, and zoom within a full image space of the panoramic video at specific timestamps.

20. The method of claim 16, wherein within each video stream generated from a respective one of the cameras, manipulating the viewing perspective of the respective video stream comprises at least one of pan, tilt, zoom, and change in temporal viewing direction and/or speed with an input device of at least one computer to generate the individualized video.

21. The method of claim 20, wherein the plurality of video streams enable one or more users via the at least one computer to perform both intra-camera navigation of each individual video stream and inter-camera navigation between respective video streams from each camera.