Displaying custom positioned overlays to a viewer

• US 10,523,993 B2
• Filed: 10/16/2014
• Issued: 12/31/2019
• Est. Priority Date: 10/16/2014
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Hager, IV, Joseph George
• Primary Examiner(s): Pitaro, Ryan F
• Application Number:
  US14/516,311
• Publication Number:
  US 20160112750A1
• Time in Patent Office: 1,902 Days
• Field of Search: 725 34, 345633
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/43079 of additional data with content streams on multiple devices
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4355 involving reformatting operations of additional data, e.g. HTML pages on a television screen optimising the visualization of content for information retrieval from the Internet G06F16/9577; adaptation of message content in packet-switching networks H04L51/066; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Aspects described herein include a user display unit that determines a portion of a presentation currently being viewed by a user through a transparent display. For example, if the display area is a theater screen, only a portion of the screen may be viewable to the user through the transparent display. The display unit may display metadata on the transparent display with a spatial relationship to one or more objects in the presentation. For example, the display unit may output a text bubble near an actor in the presentation that provides an interesting fact about the actor which may overlay or occlude the presentation. In one aspect, if the object in the presentation moves or the display unit is reoriented, the display unit may move the metadata to maintain the spatial relationship between the object and the metadata in the transparent display.

Claims

1. A method, comprising:

receiving synchronization information associated with a media presentation being displayed on a display screen, wherein the synchronization information identifies a first position of a virtual object as displayed on the display screen;

receiving positional information from a plurality of emitters arranged in a predefined pattern relative to the display screen;

determining, based on the positional information, what portion of the media presentation is visible through a transparent display separate from the display screen, from an orientation of the transparent display relative to the display screen, wherein determining what portion of the media presentation is visible through the transparent display is based on unique codes received from individual emitters arranged in a predetermined pattern relative to the display screen that indicate which emitters of the plurality of emitters are visible to the transparent display;

determining, based on the unique codes that identify a physical location and a current orientation of the transparent display relative to the display screen, a first location of the virtual object on the transparent display as visible through the transparent display;

displaying metadata at a second location, different from the first location, on the transparent display based on the first location of the virtual object as visible through the transparent display, the metadata corresponding with the virtual object; and

upon determining that the virtual object has moved from the first location on the transparent display to a third location different from the first location, displaying the metadata at a fourth location on the transparent display different from the second location to maintain a spatial relationship between the metadata in the transparent display and the virtual object.

2. The method of claim 1, wherein the synchronization information comprises a time code corresponding to a scene in the media presentation.

3. The method of claim 1, wherein the display screen is one of a projector screen and a television.

4. The method of claim 1, wherein the transparent display is a wearable device.

5. The method of claim 1, wherein determining the orientation of the transparent display relative to the display screen includes receiving orientation data from a gyroscope and an accelerometer associated with the transparent display.

6. A display unit, comprising

a transparent display that permits a user to view a media presentation displayed on a display screen external to the display unit;

a communicator configured to receive synchronization information associated with the media presentation, wherein the synchronization information identifies a position of a virtual object as displayed on the display screen;

a receiver configured to receive code information from a plurality of emitters arranged in a predefined pattern relative to the display screen, wherein the code information identifies a current physical location and a current orientation of the display unit relative to the display screen to determine a first location of the virtual object on the transparent display, and what portion of the virtual object is visible through the transparent display based on unique codes received from individual emitters that indicate which emitters of the plurality of emitters are visible to the transparent display;

a processor configured to perform an operation, the operation comprising;

displaying metadata at a second location on the transparent display, different from the first location, based on the first location of the virtual object as visible through the transparent display, the metadata corresponding with the virtual object; and

upon determining that the virtual object has moved to a third location different from the first location on the transparent display, displaying the metadata at a fourth location on the transparent display different from the second location to maintain a spatial relationship between the metadata in the transparent display and the virtual object on the transparent display.

7. The display unit of claim 6, wherein the synchronization information comprises a time code corresponding to a scene in the media presentation.

8. The display unit of claim 6, the display unit is a wearable device.

9. The display unit of claim 6, wherein the code information received by the receiver includes one or more codes uniquely associated with a corresponding one or more emitters of the plurality of emitters, wherein a given code identifies a respective emitter of the plurality of emitters to the receiver.

10. The display unit of claim 6, further comprising:

an accelerometer;

a gyroscope; and

wherein determining the orientation of the transparent display relative to the display screen includes receiving orientation data from the gyroscope and the accelerometer.

11. A non-transitory computer-readable storage medium storing instructions, which when executed by a processing device, perform an operation for displaying metadata in a transparent display, the operation comprising:

receiving, at a display device including the transparent display, at least one unique code from a plurality of unique codes that identify a respective emitter of a plurality of emitters arranged in a predetermined pattern relative to a display screen providing a media presentation, wherein the display screen is separate from the display device;

determining, based on the at least one unique code received, a physical location for the display device relative to the display screen;

determining an orientation of the transparent display relative to the display screen;

receiving synchronization information associated with the media presentation, wherein the synchronization information identifies a position of a virtual object as displayed on the display screen;

determining what portion of the media presentation is visible through the transparent display based on which unique codes of the plurality of unique codes are received to indicate which emitters of the plurality of emitters are visible to the transparent display;

determining a first location for the virtual object on the transparent display as viewable through the transparent display;

displaying metadata at a second location, different than the first location, on the transparent display based on the first location of the virtual object as visible through the transparent display, the metadata corresponding with the virtual object; and

upon determining the virtual object has moved to a third location different than the first location on the transparent display, displaying the metadata at a fourth location on the transparent display different from the second location to maintain a spatial relationship between the metadata in the transparent display and the virtual object as viewable through the transparent display.

12. The non-transitory computer-readable storage medium of claim 11, wherein determining the orientation of the transparent display relative to the display screen includes receiving orientation data from a gyroscope and an accelerometer.

13. The non-transitory computer-readable storage medium of claim 11, wherein the virtual object moves to the third location on the transparent display while remaining at the position on the display screen when the transparent display is reoriented relative to the display device while remaining at the physical location.

14. The non-transitory computer-readable storage medium of claim 11, wherein the virtual object moves to the third location on the transparent display by moving from the position on the display screen to a new position on the display screen while the transparent display maintains the orientation and remains at the physical location.

15. The non-transitory computer-readable storage medium of claim 11, further comprising:

in response to determining that the virtual object on the display device is not viewable through the transparent display, ceasing display of the metadata.