Dynamic video image synthesis using multiple cameras and remote control

• US 10,129,579 B2
• Filed: 10/15/2015
• Issued: 11/13/2018
• Est. Priority Date: 10/15/2015
• Status: Active Grant

• Current Assignee: AT&T Mobility II LLC (AT&T, Inc.)
• Original Assignee: AT&T Mobility II LLC (AT&T, Inc.)
• Inventors: Meredith, Sheldon Kent, Fix, Jeremy
• Primary Examiner(s): Flynn, Randy A
• Application Number:
  US14/884,495
• Publication Number:
  US 20170111674A1
• Time in Patent Office: 1,125 Days
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6408 Unicasting
• CPC Class Codes: H04N 21/8549 Creating video summaries, e.g. movie trailer retrieval in video databases by using presentations in form of a video summary G06F16/739

Abstract

Aspects of the subject disclosure may include, for example, receiving, at a broadcast image processor, from a single broadcast event, a plurality of camera feeds, wherein the camera feeds each comprise an image of the single broadcast event from a different angle, providing, by the broadcast image processor, a summary of the plurality of camera feeds to a media processor, receiving, by the broadcast image processor, a request to select a requested angle from among the plurality of camera feeds from the media processor, and creating, by the broadcast image processor, a custom view from the plurality of camera feeds according to the request for the media processor. Other embodiments are disclosed.

Claims

1. A method, comprising:

receiving by a broadcast image processor, from a broadcast event, a plurality of camera feeds, wherein each of the plurality of camera feeds comprises an image of the broadcast event from a different angle, wherein each of the plurality of camera feeds is in one of a plurality of camera feed groups, and wherein each of the plurality of camera feed groups comprises at least two of the plurality of camera feeds;

sending to a mobile device, by the broadcast image processor, camera feed information;

receiving, by the broadcast image processor, a request from the mobile device for presenting a custom viewing angle of the broadcast event, wherein the request is generated via a graphical user interface of the mobile device, and wherein the graphical user interface includes summaries of the plurality of the camera feeds that are generated by the mobile device based upon the camera feed information received from the broadcast image processor;

selecting, by the broadcast image processor, a first camera feed of the plurality of camera feeds and a second camera feed of the plurality of camera feeds according to camera angle data included in the request;

synthesizing, by the broadcast image processor, the custom viewing angle of the broadcast event according to the first camera feed and the second camera feed;

providing, by the broadcast image processor, the custom viewing angle of the broadcast event to a media processor, wherein the synthesizing and providing are performed in real time responsive to the request from the mobile device via the graphical user interface, and wherein both the media processor and the mobile device are in communication with the broadcast image processor; and

instructing, by the broadcast image processor, the mobile device to provide a visual presentation in the graphical user interface of a time slider feature of available content of the plurality of camera feeds in a buffer, wherein the buffer contains buffered content from the plurality of camera feeds, wherein the visual presentation further includes a plurality of time selection elements to access the available content from the plurality of camera feeds from the time slider feature, wherein each time selection element of the plurality of time selection elements is associated with a respective one of the available content of the plurality of camera feeds in the buffer; and

receiving, by the broadcast image processor, a rewind request to select the custom viewing angle from an earlier point in time, wherein the earlier point in time is determined based upon detecting an input at one of;

a first time selection element of the plurality of time selection elements that corresponds to all of the camera feeds of a first one of the plurality of camera feed groups, or

a second time selection element of the plurality of time selection elements that corresponds to all of the camera feeds of a second one of the plurality of camera feed groups.

2. The method of claim 1, wherein the first time selection element comprises a first time slider and wherein the second time selection element comprises a second time slider.

3. The method of claim 1, wherein each of the plurality of camera feeds include audio information, and wherein the broadcast image processor comprises a processing system.

4. The method of claim 1, wherein the first camera feed comprises first images at a first viewing angle, wherein the second camera feed comprises second images at a second viewing angle, and wherein the synthesizing comprises interpolating between the first images and the second images to generate the custom viewing angle of the broadcast event.

5. The method of claim 1, wherein the broadcast image processor provides, in response to the rewind request, a buffered presentation of the custom viewing angle from the buffer.

6. A non-transitory, machine-readable storage medium comprising executable instructions that, when executed by a processing system of a broadcast image processor, facilitate performance of operations, the operations comprising:

receiving from a broadcast event a plurality of camera feeds, wherein each of the plurality of camera feeds comprises an image of the broadcast event from a different angle over a time period, wherein each of the plurality of camera feeds is in one of a plurality of camera feed groups, and wherein each of the plurality of camera feed groups comprises at least two of the plurality of camera feeds, wherein the broadcast event further includes camera feed information describing the plurality of camera feeds;

sending, to a mobile device, a summary of selectable options associated with the plurality of camera feeds, wherein the mobile device is configured to present the summary of selectable options associated with the plurality of camera feeds in a selection presentation on a graphical user interface, wherein the selection presentation includes time selection data and camera angle creation data, wherein the graphical user interface provides a visual presentation of a time slider feature of available content of the plurality of camera feeds in a buffer, wherein the buffer contains buffered content from the plurality of camera feeds, wherein the visual presentation further includes a plurality of time selection elements to access the available content from the plurality of camera feeds from the time slider feature, wherein each time selection element of the plurality of time selection elements is associated with a respective one of the available content of the plurality of camera feeds in the buffer, and wherein the selection presentation receives an input to create a request including a custom time and a custom camera angle, wherein the custom time is determined based upon detecting an input at one of;

a first time selection element of the plurality of time selection elements that corresponds to all of the camera feeds of a first one of the plurality of camera feed groups;

or

a second time selection element of the plurality of time selection elements that corresponds to all of the camera feeds of a second one of the plurality of camera feed groups;

receiving the request from the mobile device, and wherein the graphical user interface includes summaries of the camera feeds that are generated by the mobile device based upon the camera feed information received from the broadcast event;

synthesizing a custom viewing angle of the broadcast event according to the request by utilizing a first camera feed of the plurality of camera feeds and a second camera feed of the plurality of camera feeds; and

providing, to a media processor, the custom viewing angle of the broadcast event, wherein the synthesizing and providing are performed in real time responsive to the request from the mobile device via the graphical user interface, and wherein both the media processor and the mobile device are in communication with the broadcast image processor.

7. The non-transitory, machine-readable storage medium of claim 6, wherein the processing system comprises a plurality of processors operating in a distributed processing environment.

8. The non-transitory, machine-readable storage medium of claim 6, wherein the first time selection element comprises a first time slider and wherein the second time selection element comprises a second time slider.

9. The non-transitory, machine-readable storage medium of claim 6, wherein the providing of the custom viewing angle is via a unicast channel between the broadcast image processor and the media processor.

10. The non-transitory, machine-readable storage medium of claim 6, wherein the providing of the custom viewing angle is via a broadcast channel from the broadcast image processor.

11. The non-transitory, machine-readable storage medium of claim 6, wherein the request comprises a plurality of requests.

12. The non-transitory, machine-readable storage medium of claim 6, wherein the broadcast image processor provides, in response to the request including the custom time and the custom camera angle, a buffered presentation of the custom viewing angle from the buffer.

13. An apparatus, comprising:

a processing system including a processor; and

a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising;

receiving a plurality of virtual camera feeds for a video gaming event, wherein each of the plurality of virtual camera feeds comprises an image from the video gaming event, wherein each of the plurality of virtual camera feeds is in one of a plurality of virtual camera feed groups, and wherein each of the plurality of virtual camera feed groups comprises at least two of the plurality of virtual camera feeds;

providing the video gaming event to a media processor;

providing, to a mobile device including a graphical user interface, a summary of selectable options associated with the plurality of virtual camera feeds, wherein the graphical user interface provides a visual presentation of a time slider feature of available content of the plurality of virtual camera feeds in a buffer, wherein the buffer contains buffered content from the plurality of virtual camera feeds, wherein the visual presentation further includes a plurality of time selection elements to access the available content from the plurality of virtual camera feeds from the time slider feature, wherein each time selection element of the plurality of time selection elements is associated with a respective one of the available content of the plurality of virtual camera feeds in the buffer;

receiving a request from the mobile device, responsive to input via the graphical user interface, for presenting a custom viewing of the video gaming event based on the summary of selectable options, wherein the request comprises timing data and camera angle data for generating the custom viewing of the video gaming event, wherein the timing data is determined based upon detecting an input at one of;

a first time selection element of the plurality of time selection elements that corresponds to all of the virtual camera feeds of a first one of the plurality of virtual camera feed groups, or

a second time selection element of the plurality of time selection elements that corresponds to all of the virtual camera feeds of a second one of the plurality of virtual camera feed groups, and wherein the graphical user interface includes summaries of the virtual camera feeds that are generated by the mobile device based upon the selectable options;

creating the custom viewing from the plurality of virtual camera feeds according to the request by synthesizing the custom viewing from a first virtual camera feed of the plurality of virtual camera feeds and a second virtual camera feed of the plurality of virtual camera feeds, wherein the first virtual camera feed and the second virtual camera feed are determined based on the request; and

providing, to the media processor, the custom viewing, wherein the synthesizing and providing are performed in real time responsive to the request from the mobile device, and wherein both the media processor and the mobile device are in communication with the processing system.

14. The apparatus of claim 13, wherein the request comprises a plurality of requests.

15. The apparatus of claim 13, wherein the operations further comprise providing the custom viewing to the media processor via a unicast communication path, and wherein the processing system comprises a plurality of processors operating in a distributed processing environment.

16. The apparatus of claim 13, wherein the operations further comprise providing, to the media processor, a summary of the plurality of virtual camera feeds via a unicast communication path.

17. The apparatus of claim 13, wherein the operations further comprise receiving a second request to select a second custom viewing of the video game event.

18. The apparatus of claim 17, wherein the operations further comprise creating the second custom viewing from the plurality of virtual camera feeds by synthesizing the first virtual camera feed of the plurality of virtual camera feeds and the second virtual camera feed of the plurality of virtual camera feeds.

19. The apparatus of claim 18, wherein the operations further comprise providing the second custom viewing to the media processor via a unicast communication path.

20. The apparatus of claim 13, wherein the operations further comprise, providing, in response to the request, a buffered presentation of the custom viewing angle from the buffer.