METHOD OF DISPLAYING MULTIPLE CONTENT STREAMS ON A USER DEVICE

• US 20190045232A1
• Filed: 09/15/2018
• Published: 02/07/2019
• Est. Priority Date: 09/26/2009
• Status: Active Grant

• Current Assignee: Mimik Technology Canada Incorporated
• Original Assignee: Mimik Technology, Inc.
• Inventors: SHARIF-AHMADI, Seyed M., ARJOMANDI, Fay
• Granted Patent: US 10,893,322 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 43/0835 One way packet loss
• CPC Class Codes: H04L 43/0847 Transmission error
• CPC Class Codes: H04L 43/0888 Throughput
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/1021 based on client or server locations
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561
• CPC Class Codes: H04M 15/42 Dynamic individual rates per user
• CPC Class Codes: H04N 21/23113 involving housekeeping operations for stored content, e.g. prioritizing content for deletion because of storage space restrictions storage management, e.g. defragmentation G06F3/0604; snloading stored programs G06F9/445; housekeeping operations in file systems, e.g. deletion policies G06F16/10; buffering arrangements in a network node or in an end terminal in packet networks H04L49/90
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/25891 : being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2665 : Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4183 : providing its own processing capabilities, e.g. external module for video decoding
• CPC Class Codes: H04N 21/4263 : involving specific tuning arrangements, e.g. two tuners
• CPC Class Codes: H04N 21/4334 : Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/4335 : Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions storage management, e.g. defragmentation G06F3/0604; unloading stored programs G06F9/445; storage management in file systems G06F16/10; buffering arrangements in a network node or in an end terminal in packet networks H04L49/90
• CPC Class Codes: H04N 21/43615 : Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/437 : Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/4402 : involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/440245 : the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/44204 : Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/44213 : Monitoring of end-user related data arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/44218 : Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/44226 : on social networks
• CPC Class Codes: H04N 21/4532 : involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/458 : Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4667 : Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04W 4/027 : using movement velocity, acceleration information

Abstract

A method and system for micro-cloud computing is described. An application serving node, which is a specifically configured piece of customer premises equipment such as a set-top box, is the server for a micro-cloud network. Various user devices that form part of the micro-cloud network, such as television sets and smart phones, communicate with the application serving node. The application serving node is configured with software that allows various heterogeneous types of data to be obtained and streamed to the user devices in multiple ways. The application serving node performs much of the processing necessary for such content streaming itself and thus represents an edge-based network architecture.

Claims

1. A method of displaying multimedia content, the multimedia content including at least one video stream from a video source, on a display of a user device, said user device registered to a serving node, the method comprising:

determining, by said serving node, a type of said user device and display capabilities of said user device;

determining, by said serving node, a network connection from said serving node to said user device;

streaming, via said serving node, said at least one video stream from said video source to the display of said user device, wherein said at least one video stream is transcoded and transrated based on the display capabilities and the network connection;

inspecting, by said serving node, said at least one video stream to determine an identity of a user associated with said at least one video stream, a context associated with said at least one video stream, and a time said at least one video stream was displayed on the display of said user device;

comparing, by said serving node, said at least one video stream to a history, associated with the user, stored at said serving node to determine whether said at least one video stream is typical or atypical in relation to the user;

comparing, by said serving node, the context of said at least one video stream with a history of other users to determine whether a social variable is associated with said at least one video stream; and

updating, by said serving node, the history associated with the user and user characterization associated with the user based on the context, the time, said type of the user device, whether said at least one video stream was typical, and whether the social variable was present.

2. The method of claim 1, wherein said at least one video stream is one or more of television content or Internet content.

3. The method of claim 1, wherein updating the user characterization associated with the user is further based on a type of the multimedia content, and wherein the type of the multimedia content comprises one of video, image, text, audio, RSS feed or mixed.

4. The method of claim 1, wherein streaming the transcoded and transrated at least one video stream from said video source to the display of said user device comprises:

rearranging and resizing, by the serving node, the multimedia content to fit within a screen of said display of said user device.

5. The method of claim 1, further comprising:

receiving, by the serving node, the multimedia content in a first format;

converting, by the serving node, the first format of a picture frame to a second format picture frame;

extracting, by the serving node, additional content from the video source to include in the multimedia content;

overlaying, by the serving node, the additional content to the second format picture frame; and

encoding, by the serving node, the second format picture frame to said at least one video stream before providing said at least one video stream to said user device.

6. The method of claim 1, wherein said serving node is located at a premises of said user associated with said user device.

7. The method of claim 1, wherein said user device is a television.

8. The method of claim 1, wherein said user device is a mobile device.

9. The method of claim 1, wherein said at least one video stream is multiplexed by said serving node.

10. The method of claim 1, wherein said network connection is a wireless connection.

11. A system for displaying multimedia content, the system comprising:

a user device, registered to a serving node, said serving node configured to receive at least one video stream from a source,

said serving node having an interface to said user device, said interface configured to determine coordinates for said at least one video stream, and

wherein said serving node is configured to;

determine a type of said user device, display capabilities of said user device, and a network connection to said user device;

transcode and transrate said at least one video stream based on the display capabilities of said user device and said network connection;

stream said at least one video stream that is transcoded and transrated to a display of said user device using said coordinates;

inspect said at least one video stream to determine an identity of a user associated with said at least one video stream, a context associated with said at least one video stream, and a time at which said at least one video stream was accessed by the user;

compare said at least one video stream to a history, associated with the user, stored at said serving node to determine whether said at least one video stream is typical or atypical in relation to the user;

compare the context associated with said at least one video stream with a history of other users to determine whether a social variable is associated with said at least one video stream; and

update the history associated with the user and user characterization associated with the user based on the context, the time, said type of user device, whether said at least one video stream was typical, and whether the social variable was present.

12. The system of claim 11, wherein said at least one video stream is one or more of television content or Internet content.

13. The system of claim 11, wherein the serving node is further configured to update the user characterization associated with the user based on a type of the multimedia content, and wherein the type of the multimedia content comprises one of video, image, text, audio, RSS feed or mixed.

14. The system of claim 11, wherein the serving node is further configured to stream said at least one video stream that is transcoded and transrated to the display of said user device using said coordinates by rearranging and resizing the multimedia content to fit within a screen of said display of said user device.

15. The system of claim 11, wherein the serving node is further configured to:

receive, the multimedia content in a first format;

convert the first format of a picture frame to a second format picture frame;

extract additional content from the video source to include in the multimedia content;

overlay the additional content to the second format picture frame; and

encode the second format picture frame to said at least one video stream before providing said at least one video stream to said user device.

16. The system of claim 11, wherein said serving node is located at a premises of said user associated with said user device.

17. The system of claim 11, wherein said user device is a television.

18. The system of claim 11, wherein said user device is a mobile device.

19. The system of claim 11, wherein said at least one video stream is multiplexed by said serving node.

20. The system of claim 11, wherein said network connection is a wireless connection.