Methods and apparatus for media navigation

• US 9,288,511 B2
• Filed: 02/16/2012
• Issued: 03/15/2016
• Est. Priority Date: 02/18/2011
• Status: Active Grant

• Current Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Lin, Kui, Yu, Hong Heather
• Primary Examiner(s): Vu, Kieu
• Assistant Examiner(s): Gattew, Asteway T
• Application Number:
  US13/398,682
• Publication Number:
  US 20120216121A1
• Time in Patent Office: 1,489 Days
• Field of Search: 715/716, 715/719, 715/720, 715723-726
• US Class Current: 1/1
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 21/8583 by creating hot-spots

Abstract

In accordance with an embodiment of the present invention, an apparatus for streaming a media includes a server side receiver for receiving a request to stream a media from a media player. The apparatus further includes a content generator, a server side transmitter, and a media stream generator. The content generator is configured to generate content information providing a plurality of presentation options to consume the media. The server side transmitter is configured to send the content information. The server side receiver is further configured to receive a selected presentation option from amongst the plurality of presentation options. The media stream generator is configured to generate a media stream comprising the media based on the selected presentation option.

Claims

1. A method of playing media, the method comprising:

receiving content information that provides a plurality of options to consume the media, wherein the media is previously generated, wherein the content information comprises information relating to contextual, spatial, or temporal features of the media, wherein receiving the content information comprises;

receiving an index file describing a structure of the contextual, spatial, or temporal features within the media,

receiving a descriptor data file comprising descriptors for the contextual, spatial, or temporal features, the descriptor data file being received sequentially using a multiple layered scheme, and

receiving a manifest file comprising description of the descriptor data file;

displaying the content information of a media player;

sending a request to stream the media based on one option selected from the plurality of options;

receiving a first media stream; and

displaying the first media stream, the first media stream being displayed in accordance with the selected option.

2. The method of claim 1, further comprising:

displaying a second media stream before sending the request to stream the media; and

stopping the second media stream after receiving the first media stream.

3. The method of claim 2, wherein the content information is displayed outside a player main window displaying the first media stream.

4. The method of claim 1, wherein the content information comprises information for objects, regions, scenes, or stories within the media.

5. The method of claim 4, wherein the objects comprise people, things, and animals.

6. The method of claim 1, wherein the content information is displayed in a play control box.

7. The method of claim 1, wherein sending the request to stream the media comprises sending the request to stream the media based on a selection from a clickable option.

8. The method of claim 1, wherein the plurality of options for consuming the media comprises an option selected from the group consisting of highlight based media consumption, summary based media consumption, object based media consumption, scene based media consumption, and heat map based media consumption.

9. The method of claim 8, wherein the plurality of options further comprises an option selected from the group consisting of video frame rate, video resolution, audio bit depth, audio bit rate, and audio channels.

10. The method of claim 1, wherein the plurality of options for consuming the media comprises highlight and heat map based media consumption.

11. The method of claim 1, wherein the content information comprises information relating to temporal portions of the media stream.

12. The method of claim 1, wherein the content information comprises information relating to spatial portions of the media stream.

13. The method of claim 1, wherein the plurality of options of consuming the media comprises consuming additional media related to temporal portions of the media stream.

14. The method of claim 13, wherein the additional media comprise a media selected from the group consisting of cut-out scenes, related interviews, critiques, synopsis, editorials, ratings, and reviews.

15. The method of claim 1, wherein the first media stream comprises navigable parts configured to be selected for further streaming.

16. The method of claim 15, further comprising:

sending a request to stream a selected navigable part of the first media stream;

receiving a second media stream with the selected navigable part; and

displaying the second media stream, wherein a resolution of the selected navigable part in the second media stream is higher than a resolution of the selected navigable part in the first media stream.

17. An apparatus for playing media, the apparatus comprising:

an interface comprising a receiver and a transmitter,

the receiver comprising at least one of;

wireless antennas and wired ports, the receiver configured to receive content information that provides a plurality of options to consume the media, wherein the media is previously generated, wherein the content information comprises information relating to contextual, spatial, or temporal features of the media; and

the transmitter comprising at least one of;

wireless antennas and wired ports; and

a processor coupled to the interface and coupled to a display, the processor operable to execute instructions that display the content information of a media player;

the transmitter configured to send a request to stream the media based on one option selected from the plurality of options,

wherein the receiver is further configured to receive a media stream, and wherein the processor is further operable to execute instructions that display the media stream in accordance with the selected option,

wherein the receiver is configured to receive an index file describing a structure of the contextual, spatial, or temporal features within the media, wherein the receiver is configured to receive a descriptor data file comprising descriptors for the contextual, spatial, or temporal features, wherein the descriptor data file is received sequentially using a multiple layered scheme, and wherein the receiver is configured to receive a manifest file comprising description of the descriptor data file.

18. The apparatus of claim 17, wherein the content information comprises information for objects, regions, scenes, or stories within the media.

19. The apparatus of claim 18, wherein the objects comprise people, things, and animals.

20. The apparatus of claim 17, wherein the display is further configured to display the content information outside a player main window displaying the media stream.

21. The apparatus of claim 17, wherein the display is further configured to display the content information in a play control box.

22. A method of displaying media, the method comprising:

receiving a request to stream a media, wherein the media is previously generated;

generating content information providing a plurality of presentation options to consume the media, wherein the content information comprises information relating to contextual, spatial, or temporal features of the media, wherein generating the content information comprises;

generating the contextual, spatial, or temporal features within the media,

generating a descriptor data file comprising descriptors for the contextual, spatial, or temporal features,

generating an index file describing a structure of the contextual, spatial, or temporal features, and

generating a manifest file comprising a description of the descriptor data file;

sending the content information, wherein sending the content information comprises;

sending the manifest file and the index file, and

sending the descriptor data file sequentially using a multiple layered scheme;

receiving a selected presentation option from amongst the plurality of presentation options; and

generating a first media stream comprising the media based on the selected presentation option.

23. The method of claim 22, wherein sending the content information comprises sending the content information along with a second media stream.

24. The method of claim 22, further comprising sending the first media stream.

25. The method of claim 22, wherein the plurality of presentation options for consuming the media comprises a presentation option selected from the group consisting of highlight based media consumption, summary based media consumption, object based media consumption, scene based media consumption, and heat map based media consumption.

26. The method of claim 25, wherein the plurality of presentation options further comprises a presentation option selected from the group consisting of video frame rate, video resolution, audio bit depth, audio bit rate, and audio channels.

27. The method of claim 22, wherein the plurality of presentation options comprises highlight and heat map based media consumption.

28. The method of claim 22, wherein the content information comprises information relating to temporal portions of the first media stream.

29. The method of claim 22, wherein the content information comprises information relating to spatial portions of the first media stream.

30. An apparatus for streaming a media, the apparatus comprising:

an interface comprising a receiver and a transmitter,

the receiver comprising at least one of;

wireless antennas and wired ports, the receiver configured to receive a request to stream a media, where the media is previously generated; and

the transmitter comprising at least one of;

wireless antennas and wired ports;

a processor coupled to the interface, the processor operable to;

generate content information providing a plurality of presentation options to consume the media, wherein the content information comprises information relating to contextual, spatial, or temporal features of the media;

generate the contextual, spatial, or temporal features within the media;

generate a descriptor data file comprising descriptors for the contextual, spatial, or temporal features;

generate an index file describing a structure of the contextual, spatial, or temporal features; and

generate a manifest file comprising a description of the descriptor data file; and

wherein the transmitter is configured to send the content information, the manifest file and the index file, wherein the transmitter is further configured to send the descriptor data file sequentially using a multiple layered scheme, wherein the receiver is further configured to receive a selected presentation option from amongst the plurality of presentation options, and

wherein the processor is further operable to generate a first media stream comprising the media based on the selected presentation option.