Apparatus and methods for manipulating multicamera content using content proxy

• US 10,078,644 B1
• Filed: 01/19/2016
• Issued: 09/18/2018
• Est. Priority Date: 01/19/2016
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Newman, David, Vaden, Mark, Fischer, Rolf, Polonichko, Vadim
• Primary Examiner(s): Wang, Xi
• Application Number:
  US15/001,097
• Time in Patent Office: 973 Days
• Field of Search: 348 38, 348 42, 348 51
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: H04N 1/00209 Transmitting or receiving image data, e.g. facsimile data, via a computer, e.g. using e-mail, a computer network, the internet, I-fax
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 1/2158 using a detachable storage unit
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

Content proxy may be obtained. Content may include video captured by an action camera. Content proxy may include metadata information obtained contemporaneous with the content and stored in a session container. Content proxy may include lower data rate version of the content (thumbnails). Content proxy information may be viewed and/or analyzed in order to obtain one or more highlights. Content portion corresponding to the highlight may be obtained. Multiple versions of content proxy obtained by multiple cameras may be used to identify, display, and/or share content portions in a multi-camera/multiuser applications.

Claims

1. A non-transitory computer readable medium configured to store a plurality of computer-readable instructions which, when executed by one or more processors, are configured to:

access a first content proxy containing information related to a first imaging content acquired by a first capture device having a first clock associated therewith, the first imaging content including a first sequence of images, the first content proxy including (i) a second sequence of images characterized by a first data rate configured lower than a second data rate of the first sequence of images, and (ii) one or more links to the images of the first sequence of images;

access a second content proxy containing information related to second imaging content acquired by a second capture device having a second clock associated therewith, the second imaging content including a third sequence of images, the second content proxy including (i) a fourth sequence images characterized by a third data rate configured lower than a fourth data rate of the third sequence of images, and (ii) one or more links to the images of the third sequence of images;

evaluate the images of the second sequence to obtain parameters related to one or more first scenes;

evaluate the images of the fourth sequence to obtain parameters related to one or more second scenes;

obtain an overlap between the one or more first scenes and the one or more second scenes such that a given scene occurring within the one or more first scenes occurs within the one or more second scenes;

obtain a first link to an image of the first sequence of images corresponding to the given scene occurring within the one or more first scenes;

obtain a second link to an image of the third sequence of images corresponding to the given scene occurring within the one or more second scenes; and

provide the first link and the second link to a display process, the provision of the first link and the second link configured to enable display of the given scene based on stitching of the image of the first sequence of images and the image of the second sequence of images.

2. The non-transitory medium of claim 1, wherein the first data rate includes a first frame rate and the second data rate includes a second frame rate, and the first frame rate is lower than the second frame rate.

3. The non-transitory medium of claim 1, wherein the first data rate includes a first byte rate characterizing number of bytes per image of the second sequence of images and the second data rate includes a second byte rate characterizing number of bytes per image of the first sequence of images and the first byte rate is lower than the second byte rate.

4. The non-transitory medium of claim 3, wherein:

the third data rate includes one or both of (i) a third frame rate, the fourth data rate including a fourth frame rate, the third frame rate lower than the fourth frame rate; and

(ii) a third byte rate characterizing number of bytes per image of the fourth sequence of images, the fourth data rate including a fourth byte rate characterizing number of bytes per image of the third sequence of images, the third byte rate lower than the fourth byte rate.

5. A system for providing images, the system comprising:

one or more physical processors configured by machine-readable instructions to;

access a first content proxy containing information related to a first imaging content acquired by a first capture device having a first clock associated therewith, the first imaging content including a first sequence of images, the first content proxy including (i) a second sequence of images characterized by a first data rate configured lower than a second data rate of the first sequence of images, and (ii) one or more links to the images of the first sequence of images;

access a second content proxy containing information related to second imaging content acquired by a second capture device having a second clock associated therewith, the second imaging content including a third sequence of images, the second content proxy including (i) a fourth sequence images characterized by a third data rate configured lower than a fourth data rate of the third sequence of images, and (ii) one or more links to the images of the third sequence of images;

evaluate the images of the second sequence to obtain parameters related to one or more first scenes;

evaluate the images of the fourth sequence to obtain parameters related to one or more second scenes;

obtain an overlap between the one or more first scenes and the one or more second scenes such that a given scene occurring within the one or more first scenes occurs within the one or more second scenes;

obtain a first link to an image of the first sequence of images corresponding to the given scene occurring within the one or more first scenes;

obtain a second link to an image of the third sequence of images corresponding to the given scene occurring within the one or more second scenes; and

provide the first link and the second link to a display process, the provision of the first link and the second link configured to enable display of the given scene based on stitching of the image of the first sequence of images and the image of the second sequence of images.

6. The system of claim 5, wherein the first data rate includes a first frame rate and the second data rate includes a second frame rate, and the first frame rate is lower than the second frame rate.

7. The system of claim 5, wherein the first data rate includes a first byte rate characterizing number of bytes per image of the second sequence of images and the second data rate includes a second byte rate characterizing number of bytes per image of the first sequence of images and the first byte rate is lower than the second byte rate.

8. The system of claim 7, wherein:

the third data rate includes one or both of (i) a third frame rate, the fourth data rate including a fourth frame rate, the third frame rate lower than the fourth frame rate; and

(ii) a third byte rate characterizing number of bytes per image of the fourth sequence of images, the fourth data rate including a fourth byte rate characterizing number of bytes per image of the third sequence of images, the third byte rate lower than the fourth byte rate.

9. A method for providing images, the method performed by a computing system including one or more physical processors, the method comprising:

accessing, by the computing system, a first content proxy containing information related to a first imaging content acquired by a first capture device having a first clock associated therewith, the first imaging content including a first sequence of images, the first content proxy including (i) a second sequence of images characterized by a first data rate configured lower than a second data rate of the first sequence of images, and (ii) one or more links to the images of the first sequence of images;

accessing, by the computing system, a second content proxy containing information related to second imaging content acquired by a second capture device having a second clock associated therewith, the second imaging content including a third sequence of images, the second content proxy including (i) a fourth sequence images characterized by a third data rate configured lower than a fourth data rate of the third sequence of images, and (ii) one or more links to the images of the third sequence of images;

evaluating, by the computing system, the images of the second sequence to obtain parameters related to one or more first scenes;

evaluating, by the computing system, the images of the fourth sequence to obtain parameters related to one or more second scenes;

obtaining, by the computing system, an overlap between the one or more first scenes and the one or more second scenes such that a given scene occurring within the one or more first scenes occurs within the one or more second scenes;

obtaining, by the computing system, a first link to an image of the first sequence of images corresponding to the given scene occurring within the one or more first scenes;

obtaining, by the computing system, a second link to an image of the third sequence of images corresponding to the given scene occurring within the one or more second scenes; and

providing, by the computing system, the first link and the second link to a display process, the provision of the first link and the second link configured to enable display of the given scene based on stitching of the image of the first sequence of images and the image of the second sequence of images.

10. The method of claim 9, wherein the first data rate includes a first frame rate and the second data rate includes a second frame rate, and the first frame rate is lower than the second frame rate.

11. The method of claim 9, wherein the first data rate includes a first byte rate characterizing number of bytes per image of the second sequence of images and the second data rate includes a second byte rate characterizing number of bytes per image of the first sequence of images and the first byte rate is lower than the second byte rate.

12. The method of claim 11, wherein:

the third data rate includes one or both of (i) a third frame rate, the fourth data rate including a fourth frame rate, the third frame rate lower than the fourth frame rate; and

(ii) a third byte rate characterizing number of bytes per image of the fourth sequence of images, the fourth data rate including a fourth byte rate characterizing number of bytes per image of the third sequence of images, the third byte rate lower than the fourth byte rate.