Method, system and computer program product for obtaining and displaying supplemental data about a displayed movie, show, event or video game

• US 9,465,451 B2
• Filed: 03/07/2012
• Issued: 10/11/2016
• Est. Priority Date: 12/31/2009
• Status: Active Grant

• Current Assignee: FlickIntelligence, LLC (Ortiz & Lopez PLLC)
• Original Assignee: FlickIntelligence, LLC (Ortiz & Lopez PLLC)
• Inventors: Ortiz, Luis M., Krukar, Richard H., Lopez, Kermit D.
• Primary Examiner(s): Topgyal, Gelek W
• Application Number:
  US13/413,859
• Publication Number:
  US 20120167001A1
• Time in Patent Office: 1,679 Days
• Field of Search: 386239-241, 715716-722, 715/753, 725/105
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/47815 Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/4784 : receiving rewards
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/812 : involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8133 : specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8586 : by using a URL processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02

Abstract

Method, system and computer program product for displaying additional information about a displayed point of interest. A region region within a particular frame of a display can be selected to access additional information about a point of interest associated with the region. The additional information can be displayed on a secondary display, in response to selecting the region within the particular frame of the display to access the additional information about the point of interested associated with the region.

Claims

1. A method for displaying additional information about a scene element displayed in a frame of video content being presented on a display, the method comprising:

determining a location of the display in relation to an augmented reality device wherein a plurality of markers is used to determine the location of the display, wherein the augmented reality device comprises a secondary display, and wherein the location of the display is used to map points on the display to points on the secondary display;

detecting a selection of the scene element wherein a viewer looks through the augmented reality device to view the display and utilizes the augmented reality device to point at and select the scene element; and

displaying the additional information to the viewer on the secondary display, in response to the selection.

2. The method of claim 1 further comprising communicating with a mobile device wherein the viewer utilizes the mobile device to point at and select the scene element, wherein the mobile device comprises the secondary display, and wherein the mobile device is a smartphone or a pad computing device.

3. The method of claim 2 wherein a cursor is displayed on the secondary display, wherein the viewer points at the scene element by aligning the cursor to the scene element, and wherein the cursor changes in appearance when aligned over a selectable scene element.

4. The method of claim 1 further comprising synchronizing the secondary display with the display through a network to thereby synchronously present the video content.

5. The method of claim 1 wherein the scene alignment module determines the location and distance of the display in relation to the augmented reality device.

6. The method of claim 1 wherein a cursor is displayed on the secondary display and wherein the viewer points at the scene element by aligning the cursor to the scene element.

7. The method of claim 1 wherein an additional display displays additional video content to the viewer, wherein the viewer points at and selects an additional scene element presented on the additional display, wherein the display and the additional display are simultaneously viewable by the user, the method further comprising:

detecting an additional selection of the additional scene element wherein the viewer points at and selects the additional scene element; and

displaying the additional information to the viewer on the secondary display, in response to the selection.

8. A system for displaying additional information about a scene element displayed in a frame of video content being presented on a display, the system comprising:

a memory; and

a processor in communications with the memory, wherein the system is configured to perform a method, said method comprising;

determining a location of the display in relation to an augmented reality device wherein a plurality of markers is used to determine the location of the display, wherein the augmented reality device comprises a secondary display, and wherein the location of the display is used to map points on the display to points on the secondary display;

detecting a selection of the scene element wherein a viewer looks through the augmented reality device to view the display and utilizes the augmented reality device to point at and select the scene element; and

displaying the additional information to the viewer on the secondary display, in response to the selection.

9. The system of claim 8, the method further comprising communicating with a mobile device wherein the viewer points the mobile device at the display to thereby point at and select the scene element, wherein the mobile device comprises the secondary display, and wherein the mobile device is a smartphone or a pad computing device.

10. The system of claim 9 wherein a cursor is displayed on the secondary display and wherein the viewer points at the scene element by aligning the cursor to the scene element.

11. The system of claim 8 further comprising synchronizing the secondary display with the display through a network to thereby synchronously present the video content.

12. The system of claim 8 wherein the augmented reality device comprises a camera and the second display, wherein the viewer aims the camera at the display to thereby view the video content on the second display, and wherein the viewer utilizes the augmented reality device to point at and select the scene element.

13. The system of claim 8 wherein a cursor is displayed on the secondary display, wherein the viewer points at the scene element by aligning the cursor to the scene element, and wherein the augmented reality device causes the cursor to change appearance when overlaying a selectable scene element.

14. A computer program product for displaying additional information about a displayed point of interest, said computer program product comprising:

a non-transitory storage medium readable by a processor and storing instructions for execution by the processor for performing a method comprising;

communicating with an augmented reality device wherein the viewer utilizes the augmented reality device to point at and select the scene element, wherein the augmented reality device comprises a secondary display, and wherein the viewer views the display through the augmented reality device;

using markers to determine a location of the display in relation to the augmented reality device;

using the location of the display to map points on the display to points on the secondary display;

detecting a selection of the scene element wherein a viewer looks through the augmented reality device to view the display and utilizes the augmented reality device to point at and select the scene element;

and

displaying the additional information to the viewer on the secondary display in response to the selection.