Methods, systems and processor-readable media for bidirectional communications and data sharing

• US 9,965,237 B2
• Filed: 06/22/2016
• Issued: 05/08/2018
• Est. Priority Date: 09/27/2011
• Status: Active Grant

• Current Assignee: FlickIntelligence, LLC (Ortiz & Lopez PLLC)
• Original Assignee: FlickIntelligence, LLC (Ortiz & Lopez PLLC)
• Inventors: Lopez, Kermit D., Ortiz, Luis M., Krukar, Richard H.
• Primary Examiner(s): Shiberou, Mahelet
• Application Number:
  US15/189,315
• Publication Number:
  US 20160378420A1
• Time in Patent Office: 685 Days
• Field of Search: None
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03542 Light pens for emitting or receiving light
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/1431 using a single graphics controller
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42209 for displaying non-command information, e.g. electronic program guide [EPG], e-mail, messages or a second television channel
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4415 using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/47815 : Electronic shopping payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12
• CPC Class Codes: H04N 21/4784 : receiving rewards
• CPC Class Codes: H04N 21/4788 : communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8133 : specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 5/445 : for displaying additional information H04N5/50 takes precedence
• CPC Class Codes: H04W 4/60 : Subscription-based services using application servers or record carriers, e.g. SIM application toolkits

Abstract

Methods, systems and processor-readable media for supporting bidirectional communications and data sharing. One or more wireless hand held devices can be registered with one or more controllers associated with one or more multimedia displays. One or more profile icons can be selected for use as a cursor(s) during interaction of the wireless hand held device(s) with one or more multimedia display(s) during rendering of an event as data on the multimedia display(s). Supplemental data can be provided from the multimedia display(s) and/or a remote database to the wireless hand held device(s) based on a selection of the data rendered on the multimedia display(s) marked by the cursor utilizing the wireless hand held device(s).

Claims

1. An augmented reality device for accessing a video annotation infrastructure, said augmented reality device comprising:

a local display;

a scene alignment module that locates a display position in said local display from at least one marker, wherein said display position is used to map points on said local display to points on a second display and wherein said at least one marker assists said augmented reality device in determining a location and a distance of said second display;

an annotation data receiver that generates annotation selection data that is downloaded into said augmented reality device ahead of time or on-demand, wherein said annotation selection data includes cursor coordinates that yield an element identifier and annotation data that specifies at least one selectable zone comprising a combination of selectable areas and time periods during which said selectable areas are selectable and wherein said at least one selectable zone includes coordinates in both space and time;

wherein said coordinates are specified as a series of discrete coordinates;

the augmented reality device further comprising;

a local data store and a query router, wherein said query router sends queries to at least one data server and said local data store within said augmented reality device, wherein said local display displays a cursor and query results with respect to said queries overlaid on top of a displayed image; and

wherein said query results are gathered and passed for presentment to a user via said local display, wherein said local display shows said query results.

2. The augmented reality device of claim 1 wherein said annotation selection data comprises annotation data comprising data indicative of a cursor image.

3. The augmented reality device of claim 1 wherein said annotation selection data comprises annotation data comprising indicative of a template.

4. The augmented reality device of claim 1 wherein said annotation selection data comprises annotation data comprising data indicative of executable code data.

5. The augmented reality device of claim 1 further comprising a synchronization module that transmits synchronization data to an element identification module that provides said element identifier.

6. The augmented reality device of claim 5 wherein said annotation selection data comprises annotation data comprising data indicative of a cursor image.

7. The augmented reality device of claim 5 wherein said annotation selection data comprises data indicative of a template.

8. The augmented reality device of claim 5 wherein said annotation data comprises data indicative of executable code data.

9. The augmented reality device of claim 1 wherein said cursor coordinates include at least one cursor coordinate that combines an aim point and a media time stamp.

10. The augmented reality device of claim 1 wherein said coordinates are specified as a series of temporal extents and areal extents.

11. The augmented reality device of claim 1 wherein said coordinates are specified as a series of temporal extents and areal extents that change as a function of time when a selectable area moves on said local display, changes size during a scene displayed on said local display, or changes shape during said scene.

12. The augmented reality device of claim 10 wherein said areal extent comprises a bounding polygon.

13. The augmented reality device system of claim 10 wherein said areal extent comprises closed curves.

14. The augmented reality device of claim 11 wherein said scene comprises a scene of a multimedia event displayed in said local display and simultaneously on said second display wherein said multimedia event displayed on said local display and said second display is synchronized for display of said multimedia event via said local display and said second display.

15. The augmented reality device of claim 14 wherein said multimedia event comprises at least one of a movie, a live event, or a multimedia game.

16. The augmented reality device of claim 14 wherein said multimedia event is streamed as streamed video.