METHODS AND SYSTEMS FOR ASSOCIATING INPUT SCHEMES WITH PHYSICAL WORLD OBJECTS

• US 20170220103A1
• Filed: 01/29/2016
• Published: 08/03/2017
• Est. Priority Date: 01/29/2016
• Status: Active Grant

• Current Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Original Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Inventors: Lin, Edison
• Granted Patent: US 10,120,437 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/4821 using a grid, e.g. sorted out by channel and broadcast time

Abstract

Methods and systems are described herein for a media guidance application that allows users to associate input schemes with physical objects in an augmented reality environment. Specifically, the media guidance application may recognize physical objects in an augmented reality environment and allow users to identify input schemes to associate with the physical objects, wherein the input schemes are ways in which users may control presentation of media content by interacting with the physical objects.

Claims

1. A method for controlling presentation of media content with physical world objects, the method comprising:

storing a first digital description of a first physical object in an augmented reality environment of a user;

receiving a user input from the user, assigning an input scheme for controlling presentation of media content to the first physical object; and

after receiving the user input assigning the input scheme for controlling presentation of media content to the first physical object;

detecting the first physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the first digital description of the first physical object; and

in response to detecting the first physical object in the augmented reality environment, controlling presentation of media content using the input scheme.

2. The method of claim 1, wherein the first digital description of the first physical object is created using image segmentation and edge detection on an image of the first physical object.

3. The method of claim 1, wherein the first digital description of the first physical object is created using blob detection on an image of the first physical object.

4. The method of claim 1, wherein the first digital description of the first physical object is an alphanumeric value describing the shape and color of the first physical object.

5. The method of claim 1, wherein the user initially identifies the first physical object by performing a hand gesture over the first physical object.

6. The method of claim 1, wherein the user input assigning an input scheme for controlling presentation of media content to the first physical object is a combination of a voice input identifying an attribute of the presentation of media content to be controlled and a gesture input identifying the interaction with the first physical object that controls the attribute.

7. The method of claim 1, wherein the input scheme for controlling presentation of media content is one of a plurality of predefined input schemes, each associated with a physical object.

8. The method of claim 1, wherein the user input assigning an input scheme for controlling presentation of media content to the first physical object includes navigating to the input scheme in a list of predefined input schemes.

9. The method of claim 1, wherein storing a first digital description of a first physical object in an augmented reality environment comprises:

creating an object identifier associated with the first physical object; and

storing the object identifier and the first digital description in a database listing object identifiers, each corresponding to a digital description.

10. The method of claim 9, further comprising storing a media asset identifier associated with the media asset and the object identifier in a database listing object identifiers, each corresponding to a media asset.

11. A system for controlling presentation of media content with physical world objects, the system comprising:

storage circuitry configured to store a first digital description of a first physical object in an augmented reality environment of a user; and

control circuitry configured to;

receive a user input from the user, assigning an input scheme for controlling presentation of media content to the first physical object; and

after receiving the user input assigning the input scheme for controlling presentation of media content to the first physical object;

detect the first physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the first digital description of the first physical object; and

in response to detecting the first physical object in the augmented reality environment, control presentation of media content using the input scheme.

12. The system of claim 11, wherein the first digital description of the first physical object is created using image segmentation and edge detection on an image of the first physical object.

13. The system of claim 11, wherein the first digital description of the first physical object is created using blob detection on an image of the first physical object.

14. The system of claim 11, wherein the first digital description of the first physical object is an alphanumeric value describing the shape and color of the first physical object.

15. The system of claim 11, wherein the user initially identifies the first physical object by performing a hand gesture over the first physical object.

16. The system of claim 11, wherein the user input assigning an input scheme for controlling presentation of media content to the first physical object is a combination of a voice input identifying an attribute of the presentation of media content to be controlled and a gesture input identifying the interaction with the first physical object that controls the attribute.

17. The system of claim 11, wherein the input scheme for controlling presentation of media content is one of a plurality of predefined input schemes, each associated with a physical object.

18. The system of claim 11, wherein the user input assigning an input scheme for controlling presentation of media content to the first physical object includes navigating to the input scheme in a list of predefined input schemes.

19. The system of claim 11, wherein control circuitry is further configured, when storing a first digital description of a first physical object in an augmented reality environment, to create an object identifier associated with the first physical object;

and

storage circuitry further configured to store the object identifier and the first digital description in a database listing object identifiers, each corresponding to a digital description.

20. The system of claim 19, further comprising storing a media asset identifier associated with the media asset and the object identifier in a database listing object identifiers, each corresponding to a media asset.

21-50. -50. (canceled)