PROCESSING TECHNIQUES IN AUDIO-VISUAL STREAMING SYSTEMS

• US 20160173944A1
• Filed: 12/15/2015
• Published: 06/16/2016
• Est. Priority Date: 12/15/2014
• Status: Active Grant

• Current Assignee: Verizon Patent and Licensing Incorporated (Verizon Communications Inc.)
• Original Assignee: Vessel Group, Inc. (Verizon Communications Inc.)
• Inventors: Kilar, Jason A., Tom, Richard W., Lee, Lonn, Cai, Jiwen, Zhou, Yanqing, Lui, Jocelyn, Lei, Bao
• Granted Patent: US 10,070,183 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: H04B 1/3827 Portable transceivers
• CPC Class Codes: H04H 60/32 Arrangements for monitoring conditions of receiving stations, e.g. malfunction or breakdown of receiving stations
• CPC Class Codes: H04H 60/33 Arrangements for monitoring the users' behaviour or opinions
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/234345 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4516 : involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
• CPC Class Codes: H04N 21/458 : Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4622 : Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/472 : End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6582 : Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments

Abstract

Techniques are disclosed that generally relate to content delivery techniques in audio-visual systems. In an audio-visual system, a method of using sensors to incrementally present content elements on a display includes presenting a first content element on the display, receiving first data from a sensor, the first data associated with a first distance. An increment coefficient is identified, and a portion size is determined by reducing the first distance by the increment coefficient. Finally, an unseen portion of a second content element is incrementally added to the display, and a presented portion of the first content element is incrementally removed from the display, the size of the portions added and removed being equal to the determined portion size.

Claims

1. A method of using sensors to present content elements on a display of a computing device, the method comprising, by the computing device:

presenting a first content element on the display;

identifying a target display time for the first content element;

identifying a gesture count based on the target display time;

receiving data from a sensor, the data associated with a plurality of gestures;

while receiving the data from the sensor, incrementing a counter for each gesture associated with the plurality of gestures; and

when the counter corresponds to the gesture count, displaying a second content element on the display.

2. The method of claim 1, further comprising:

dynamically determining, during the incrementing of the counter, a fraction of the gesture count that is represented by the counter; and

displaying a visual indicator on the display, the visual indicator being based on the determined fraction, wherein the visual indicator is changed based on changes to the determined fraction.

3. The method of claim 1, further comprising:

identifying an increment coefficient for the first content element, wherein incrementing the counter is based on the increment coefficient.

4. The method of claim 3, further comprising:

changing the increment coefficient from a first value to a second value while incrementing the counter.

5. The method of claim 4, further comprising:

determining hardness of a gesture based on associated data,

wherein changing the increment coefficient from the first value to the second value is based on the hardness.

6. The method of claim 4, further comprising:

determining velocity of a gesture based on associated data,

wherein changing the increment coefficient from the first value to the second value is based on the velocity.

7. A method of using sensors to incrementally present content elements on a display of a computing device, the method comprising, by the computing device:

presenting a first content element on the display;

receiving first data from a sensor, the first data associated with a first distance;

identifying an increment coefficient;

determining a portion size based on the first distance and the increment coefficient, wherein the portion size is determined by reducing the first distance by the increment coefficient;

incrementally adding an unseen portion of a second content element to the display; and

incrementally removing a presented portion of the first content element from the display, wherein a size of the unseen portion added and the presented portion removed is equal to the determined portion size.

8. The method of claim 7, wherein the sensor is a touch sensor, and the first distance is a length of a swipe gesture.

9. The method of claim 7, wherein the sensor is a computer mouse, and the first distance is a length of a mouse movement gesture.

10. The method of claim 7, wherein the sensor is a computer mouse, and the first distance is a length based on turns of a mouse wheel.

11. The method of claim 7, wherein the sensor generates the first data using movement detected by a camera, and the first distance is a length of a hand gesture.

12. The method of claim 7, wherein incrementally adding the unseen portion of the second content element to the display comprises incrementally adding the unseen portion at a first edge of the display;

and

incrementally removing the presented portion of the first content element from the display comprises incrementally removing the presented portion at a second edge of the display, wherein the second edge is opposite to the first edge.

13. The method of claim 7, wherein incrementally adding the unseen portion of the second content element to the display comprises incrementally adding the unseen portion at a boundary between the unseen portion and the presented portion;

and

incrementally removing the presented portion of the first content element from the display comprises incrementally removing the presented portion at a second edge of the display, wherein the second edge is opposite to the first edge.

14. The method of claim 7, wherein during the incremental adding and removing of the respective portions of the second content element and the first content element, the first content element appears to be scrolling off the display at the second edge of the display, and the second content element appears to be scrolling on the display from the first edge.

15. The method of claim 7, wherein the second content element is a video, the video playing during the incremental adding of the second content element.

16. The method of claim 7, further comprising:

dynamically determining, during the adding and removing of the portions, a fraction of the second content element that has been added as compared to the remaining portion of the second content element that is unseen; and

displaying a visual indicator on the display, the visual indicator being based on the determined fraction, wherein the visual indicator is changed based on changes to the determined fraction.

17. The method of claim 7, further comprising:

identifying a target length of time to display the second content element on the display, wherein identifying the increment coefficient comprises;

based on the first data and additional data from the sensor, determining the increment coefficient that is estimated to incrementally display the second content element for the target length of time.

18. The method of claim 17, wherein determining the increment coefficient is further based on data from the sensor received before the first data

19. A method comprising, performing at a mobile device:

sending, from the mobile device to a server, a request for an image, the image to include a background image and at least one layer image;

receiving, at the mobile device from the server, background data corresponding to the background image;

receiving, at the mobile device from the server, first layer data referencing a plurality of versions of a first layer image to be displayed on the background image;

identifying a display characteristic of the mobile device;

obtaining the background image using the background data;

obtaining, based on the display characteristic, a first version of the first layer image of the plurality of versions of the first layer image using the first layer data;

identifying a position on the background image to overlay the first version of the first layer image according to one or more rules;

generating, by the mobile device, a final image that includes the first version of the first layer image overlaying the background image at the identified position.

20. The method of claim 19, further comprising:

receiving a first rule defining a position characteristic for overlaying the background image with the plurality of versions of the first layer image, wherein identifying the position on the background image to overlay the first version of the first layer image according to one or more rules comprises identifying a position using the position characteristic from the first rule.

21. The method of claim 20, wherein the position characteristic corresponds to a distance from an edge of a display screen of the mobile device.

22. The method of claim 21, wherein the distance form the edge of the display screen is specified as a percentage of a width of the display screen.

23. The method of claim 21, wherein the distance form the edge of the display screen is specified in pixels.

24. A method comprising performing, at a mobile device:

receiving a first image, the first image having first dimensions;

identifying a display frame for the first image, the display frame having second dimensions, the first and second dimensions being different;

identifying a display position of the first image in the display frame such that the display frame has a first blank space where the first image does not fill the display frame; and

transforming the first image to obtain a fill image, the transforming comprising;

generating a reflection image based on the first image, wherein the reflection image is a reflective version of at least a portion of the first image;

sizing the reflection image to the first blank space to obtain the fill image; and

displaying, on the mobile device, the first image and the fill image in the display frame, wherein the fill image is displayed in the first blank space.

25. The method of claim 24, wherein the transformation further comprises one or more of:

fading the colors of the fill image; and

changing the gradient colors of the fill image.

26. A method comprising performing, at a mobile device:

receiving a collection object of content items, each content item corresponding to

a computer resource;

identifying a plurality of categories in the collection object using category metadata in the collection object;

identifying a respective set of content items for each category;

generating a first scrolling list corresponding to a first category of the plurality of categories, the first scrolling list including a first set of content items of the first category;

displaying a first content item of the first scrolling list on a display screen of the mobile device;

receiving a first sensor input from a sensor of the mobile device;

upon receipt of the first sensor input;

generating a second scrolling list corresponding to a second category of the plurality of categories;

displaying a second content item of the second scrolling list on the display screen of the mobile device; and

displaying a navigation object that indicates a first number of the second category in the plurality of categories and a second number of the second content item in the second scrolling list;

receiving a second sensor input from the sensor of the mobile device, the second sensor input selecting the second content item; and

upon receipt of the second sensor input, accessing the computer resource corresponding to the second content.

27. The method of claim 26, wherein the first sensor input includes a swipe along the display screen.

28. The method of claim 26, wherein during the first sensor input, the navigation object is displayed in a transition space between the display of the first content item of the first scrolling list on the display screen and the display of the second content item of the second scrolling list on the display screen of the mobile device.