Methods of and systems for content search based on environment sampling

• US 10,506,274 B2
• Filed: 08/14/2017
• Issued: 12/10/2019
• Est. Priority Date: 01/06/2011
• Status: Active Grant

• Current Assignee: Veveo, Inc. (Adeia Inc.)
• Original Assignee: Veveo, Inc. (Adeia Inc.)
• Inventors: Aravamudan, Murali, Rajasekharan, Ajit
• Primary Examiner(s): Maung, Nay A
• Assistant Examiner(s): Torres, Jose
• Application Number:
  US15/676,764
• Publication Number:
  US 20180091844A1
• Time in Patent Office: 848 Days
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/23 Processing of content or additional data; Elementary server operations; Server middleware
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/25 Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies maintenance or administration in data networks H04L41/00
• CPC Class Codes: H04N 21/2542 for selling goods, e.g. TV shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/258 Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data arrangements for services using the result on the distributing side of broadcast systems H04H60/66; profiles in network data switching protocols H04L67/30
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12

Abstract

The present disclosure provides user interface methods of and systems for displaying at least one available action overlaid on an image, comprising displaying an image; selecting at least one action and assigning a ranking weight thereto based on at least one of (1) image content, (2) current device location, (3) location at which the image was taken, (4) date of capturing the image; (5) time of capturing the image; and (6) a user preference signature representing prior actions chosen by a user and content preferences learned about the user; and ranking the at least one action based on its assigned ranking weight.

Claims

1. A method for overlaying an image with selectable options, the method comprising:

generating for display, a visual guide overlaying an image being captured by an image capture device of a user device;

identifying an object of interest in the live image based on a proximity of the object of interest to the visual guide;

automatically identifying, based at least in part on the object of interest and context relating to the image being captured by the image capture device, a subset of actions of different types from a plurality of actions for subsequent selection by a user;

ranking each of the subset of actions based on a non-textual portion of the identified object of interest; and

generating for display the subset of actions to a user as selectable options.

2. The method of claim 1, wherein generating for display the subset of actions to the user as selectable options includes ordering the subset of actions based on the ranking.

3. The method of claim 1, further comprising selecting a highest ranking action within the subset of actions in response to user selection of a button of the user device.

4. The method of claim 1, wherein the automatically identifying further comprises using at least one of the location of the device and the location at which the live image was taken to augment the context relating to the image.

5. The method of claim 3, wherein the subset of actions includes an action to purchase an item corresponding to the object of interest from an online store front corresponding to a physical storefront that is proximate to the location of the device or the location at which the live image was taken.

6. The method of claim 1, wherein identifying the object of interest further comprises comparing the image being captured by the image capture device to a collection of at least one sample image to determine the object of interest.

7. The method of claim 1, wherein identifying the object of interest further comprises analyzing at least one partial image selected based on a proximity of the at least one partial image to a visual field of interest for the user.

8. The method of claim 1, further comprising:

storing the image being captured by the image capture device to a memory along with data about at least one of the location of the user device, the date at which the image was captured, and the time at which the image was captured at a first point in time; and

presenting the subset of actions at a second point in time in an order based on the ranking when the user later acts upon the stored live image after the first point in time.

9. The method of claim 1, further comprising:

receiving a user selection of one of the subset of actions; and

updating a profile associated with the user to include information about the one of the subset of actions selected by the user.

10. The method of claim 1, wherein the identifying the subset of actions and the ranking each of the subset of actions includes determining the ranking weight by a machine learning process.

11. A system for overlaying an image with selectable options, comprising control circuitry configured to:

generate for display, a visual guide overlaying an image being captured by an image capture device of a user device;

identify an object of interest in the live image based on a proximity of the object of interest to the visual guide;

automatically identify, based at least in part on the object of interest and context relating to the image being captured by the image capture device, a subset of actions of different types from a plurality of actions for subsequent selection by a user;

rank each of the subset of actions based on a non-textual portion of the identified object of interest; and

generate for display the subset of actions to a user as selectable options.

12. The system of claim 11, wherein the control circuitry is further configured, when generating for display the subset of actions to the user as selectable options, to order the subset of actions based on the ranking.

13. The system of claim 11, wherein the control circuitry is further configured to select a highest ranking action within the subset of actions in response to user selection of a button of the user device.

14. The system of claim 11, wherein the control circuitry is further configured, when automatically identifying the subset of actions, to use at least one of the location of the device and the location at which the live image was taken to augment the context relating to the image.

15. The system of claim 14, wherein the subset of actions includes an action to purchase an item corresponding to the object of interest from an online store front corresponding to a physical storefront that is proximate to the location of the device or the location at which the live image was taken.

16. The system of claim 11, wherein the control circuitry is further configured, when identifying the object of interest, to compare the image being captured by the image capture device to a collection of at least one sample image to determine the object of interest.

17. The system of claim 11, wherein the control circuitry is further configured, when identifying the object of interest, to analyze at least one partial image selected based on a proximity of the at least one partial image to a visual field of interest for the user.

18. The system of claim 11, wherein the control circuitry is further configured to:

store the image being captured by the image capture device to a memory along with data about at least one of the location of the user device, the date at which the image was captured, and the time at which the image was captured at a first point in time; and

presenting the subset of actions at a second point in time in an order based on the ranking when the user later acts upon the stored live image after the first point in time.

19. The system of claim 11, wherein the control circuitry is further configured to:

receive a user selection of one of the subset of actions; and

update a profile associated with the user to include information about the one of the subset of actions selected by the user.

20. The system of claim 11, wherein the control circuitry is further configured, when identifying the subset of actions and ranking each of the subset of actions, to determine the ranking weight by a machine learning process.