METHODS AND SYSTEMS FOR ASSOCIATING INPUT SCHEMES WITH PHYSICAL WORLD OBJECTS

• US 20190041977A1
• Filed: 10/02/2018
• Published: 02/07/2019
• Est. Priority Date: 01/29/2016
• Status: Active Grant

• Current Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Original Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Inventors: Lin, Edison
• Granted Patent: US 10,948,975 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/4821 using a grid, e.g. sorted out by channel and broadcast time

Abstract

Methods and systems are described herein for a media guidance application that allows users to associate input schemes with physical objects in an augmented reality environment. Specifically, the media guidance application may recognize physical objects in an augmented reality environment and allow users to identify input schemes to associate with the physical objects, wherein the input schemes are ways in which users may control presentation of media content by interacting with the physical objects.

Claims

1-50. -50. (canceled)

51. A method for associating media content with physical world objects, the method comprising:

storing a digital description of a physical object in an augmented reality environment of a user;

receiving a first user input assigning a media asset to the physical object;

receiving a second user input assigning an input scheme for controlling a presentation of the media asset, wherein the input scheme is based on the physical object; and

after receiving the first user input assigning the media asset to the physical object;

detecting the physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the digital description of the physical object;

in response to detecting the physical object in the augmented reality environment, automatically causing the media asset to be presented; and

receiving a third user input controlling the presentation of the media based on the input scheme.

52. The method of claim 51, wherein the digital description of the physical object is created using image segmentation and edge detection on an image of the physical object.

53. The method of claim 51, wherein the digital description of the physical object is created using blob detection on an image of the physical object.

54. The method of claim 51, wherein the digital description of the physical object is an alphanumeric value describing the shape and color of the physical object.

55. The method of claim 51, wherein the augmented reality environment is a real-world physical environment supplemented by computer-generated sensory inputs.

56. The method of claim 51 further comprising identifying the physical object by detecting a hand gesture over the physical object.

57. The method of claim 51, wherein the first user input assigning the media asset to the physical object is a voice input identifying the media asset.

58. The method of claim 51, wherein the user input assigning the media asset to the physical object includes hand gestures navigating to the media asset.

59. The method of claim 51, wherein storing the digital description of a physical object in the augmented reality environment comprises:

creating an object identifier associated with the physical object;

storing the object identifier and the digital description in a first database listing object identifiers, each corresponding to a digital description.

60. The method of claim 59, further comprising storing a media asset identifier associated with the media asset and the object identifier in a second database listing object identifiers, each corresponding to a media asset.

61. A system for associating media content with physical world objects, the system comprising:

storage circuitry configured to store a digital description of a physical object in an augmented reality environment of a user; and

control circuitry configured to;

receive a first user input assigning a media asset to the physical object;

receive a second user input assigning an input scheme for controlling a presentation of the media asset, wherein the input scheme is based on the physical object; and

after receiving the first user input assigning the media asset to the physical object;

detect the physical object in the augmented reality environment by comparing digital descriptions of physical objects in the augmented reality environment to the digital description of the physical object;

in response to detecting the physical object in the augmented reality environment, automatically cause the media asset to be presented; and

receive a third user input controlling the presentation of the media based on the input scheme.

62. The system of claim 61, wherein the digital description of the physical object is created using image segmentation and edge detection on an image of the physical object.

63. The system of claim 61, wherein the digital description of the physical object is created using blob detection on an image of the physical object.

64. The system of claim 61, wherein the digital description of the physical object is an alphanumeric value describing the shape and color of the physical object.

65. The system of claim 61, wherein the augmented reality environment is a real-world physical environment supplemented by computer-generated sensory inputs.

66. The system of claim 61, wherein the control circuitry is further configured to identify the physical object by detecting a hand gesture over the physical object.

67. The system of claim 61, wherein the user input assigning the media asset to the physical object is a voice input identifying the media asset.

68. The system of claim 61, wherein the first user input assigning the media asset to the physical object includes hand gestures navigating to the media asset.

69. The system of claim 61, wherein the control circuitry is further configured, when storing the digital description of a physical object in the augmented reality environment, to create an object identifier associated with the physical object;

and

wherein the storage circuitry is further configured to store the object identifier and the digital description in a first database listing object identifiers, each corresponding to a digital description.

70. The system of claim 69, wherein storage circuitry is further configured to store a media asset identifier associated with the media asset and the object identifier in a second database listing object identifiers, each corresponding to a media asset.