360° video multi-angle attention-focus recording

• US 10,225,467 B2
• Filed: 07/20/2015
• Issued: 03/05/2019
• Est. Priority Date: 07/20/2015
• Status: Active Grant

• Current Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Original Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Inventors: Eltoft, Justin, Gunn, Michael
• Primary Examiner(s): Le, Peter D
• Application Number:
  US14/803,477
• Publication Number:
  US 20170026571A1
• Time in Patent Office: 1,324 Days
• Field of Search: 348 39
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

A system and method of capturing view-point-encoded 360° video data with a 360° camera includes capturing a frame of video including a substantially 360° view and contemporaneously receiving position information from one or more mobile electronic devices such as cellphones linked to the camera. The position information identifies a viewpoint associated with each mobile electronic device. The camera records the captured video frame and the received position information together such that one or more of the viewpoints may be selected during later playback.

Claims

1. A method of capturing view-point-encoded 360°

video data with a 360°

camera, the method comprising;

capturing at the 360°

camera a frame of video including a substantially 360°

view;

receiving respective position information from a plurality of mobile electronic devices linked to the 360°

camera, the position information corresponding to a viewpoint of the respective mobile electronic device, wherein the viewpoint of a mobile electronic device comprises a view angle of the mobile electronic device, and wherein the viewpoint of a mobile electronic device further comprises a device focus of the mobile electronic device; and

recording the captured video frame in association with the received position information such that one or more viewpoints may be selected by a viewer upon playback of a series of video frames including the captured video frame.

2. The method of claim 1 wherein the captured 360°

video frame includes a plurality of sub-frames.

3. The method of claim 1 wherein the viewpoint of the mobile electronic device comprises a location of the mobile electronic device.

4. The method of claim 3 wherein one or more of the plurality of mobile electronic devices is associated with and moves in concert with an object in the captured 360°

video frame.

5. The method of claim 1 further comprising:

capturing and recording a second 360°

video frame and recording the same received position information in association with the second 360°

video frame.

6. The method of claim 5 further comprising:

capturing a third 360°

video frame and receiving supplemental positioning information from one of the plurality of mobile electronic devices and recording the third 360°

video frame in association with the supplemental positioning information.

7. A 360°

video camera for capturing view-point-encoded 360°

video data, the camera comprising;

an image-capture element;

one or more lenses configured to focus gathered light onto the image-capture element to produce a video frame; and

a controller configured to sense a position of multiple mobile electronic devices linked to the 360°

video camera, the position information of each of the multiple mobile electronic devices corresponding to a viewpoint of that mobile electronic device, and to record the video frame in association with the position information such that one or more selectable viewpoints are available upon playback of a video material including the video frame, wherein the viewpoint of a mobile electronic device comprises a view angle of the mobile electronic device and wherein the viewpoint of a mobile electronic device further comprises a device focus of the mobile electronic device.

8. The camera of claim 7 wherein the recorded video frame includes a plurality of sub-frames.

9. The camera of claim 7 wherein the viewpoint of a mobile electronic device comprises a location of the mobile electronic device.

10. The camera of claim 9 wherein the mobile electronic device is associated with and moves in concert with an object in the captured video frame.

11. The camera of claim 7 wherein the controller is further configured to record a second video frame and to record the same received position information in association with the second video frame.

12. The camera of claim 11 wherein the controller is further configured to record a third video frame, receive supplemental positioning information from at least one of the multiple mobile electronic devices, and record the third video frame in association with the supplemental positioning information.

13. A method of recording a frame of 360°

video data corresponding to a scene, the method comprising;

identifying multiple viewpoints of interest in the scene at a particular time;

capturing a 360°

video frame of the scene at the particular time; and

recording the captured 360°

video frame and the multiple identified viewpoints of interest such that they are linked, thereby allowing a playback user to select one of the multiple identified viewpoints of interest from which to view the 360°

video frame, wherein each of the one or more viewpoints of interest comprises a view angle of the one or more mobile electronic devices, a device focus of the one or more mobile electronic devices, and a location of the one or more mobile electronic devices.

14. The method of claim 13 wherein identifying the one or more viewpoints of interest in the scene at a particular time comprises receiving positioning information from one or more mobile electronic devices to which the scene is also accessible and translating the positioning information to viewpoint information.