CINEMATIC MASTERING FOR VIRTUAL REALITY AND AUGMENTED REALITY

• US 20170105052A1
• Filed: 10/08/2016
• Published: 04/13/2017
• Est. Priority Date: 10/09/2015
• Status: Active Grant

• Current Assignee: Warner Bros Entertainment Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Warner Bros Entertainment Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Gewickey, Gregory, DeFaria, Christopher, Smith, Michael, Ostrover, Lewis
• Granted Patent: US 10,511,895 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 21/214 Specialised server platform, e.g. server located in an airplane, hotel, hospital arrangements specially adapted for local area broadcast systems H04H20/61
• CPC Class Codes: H04N 21/2143 located in a single building, e.g. hotel, hospital or museum arrangements specially adapted for plural spots in a confined site in broadcast systems H04H20/63; adaptations for transmission by electric cable for domestic distribution in television systems H04N7/106
• CPC Class Codes: H04N 21/2225 Local VOD servers
• CPC Class Codes: H04N 21/422 Input-only peripherals , i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] input devices also receiving signals from specially adapted client devices H04N21/4104
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8186 specially adapted to be executed by a peripheral of the client device, e.g. by a reprogrammable remote control

Abstract

An entertainment system provides data to a common screen (e.g., cinema screen) and personal immersive reality devices. For example, a cinematic data distribution server communicates with multiple immersive output devices each configured for providing immersive output (e.g., a virtual reality output) based on a data signal. Each of the multiple immersive output devices is present within eyesight of a common display screen. The server configures the data signal based on digital cinematic master data that includes immersive reality data. The server transmits the data signal to the multiple immersive output devices contemporaneously with each other, and optionally contemporaneously with providing a coordinated audio-video signal for output via a the common display screen and shared audio system.

Claims

1. A method comprising:

communicating, by a cinematic data distribution server, with multiple immersive output devices each configured for providing one of an augmented reality (AR) output or a virtual reality (VR) output based on a data signal, wherein each of the multiple immersive output devices is present within eyesight of a display screen;

configuring the data signal based on digital cinematic master data that includes at least one of VR data or AR data; and

transmitting the data signal to the multiple immersive output devices contemporaneously.

2. The method of claim 1, further comprising outputting an image based on a video data portion of the digital cinematic master data on the display screen, contemporaneously with the transmitting.

3. The method of claim 2, further comprising configuring the data signal so when received by the multiple immersive output devices, images on the display screen are continuously extended to areas beyond an outer limit of the display screen, for each person viewing immersive output on one of the multiple immersive output devices.

4. The method of claim 2, further comprising configuring the data signal so that when received by the multiple immersive output devices, images that do not appear on the display screen are caused to appear as if located in or around a view space volume to each person viewing immersive output on one of the multiple immersive output devices.

5. The method of claim 4, configuring the data signal so that the images that do not appear on the display screen appear in a coordinate system defined relative to the each person viewing immersive output on one of the multiple immersive output devices.

6. The method of claim 4, configuring the data signal so that the images that do not appear on the display screen appear in a coordinate system defined relative to the display screen.

7. The method of claim 4, further comprising including in the data signal code enabling each person viewing immersive output on one of the multiple immersive output devices to interact with at least one of the images that do not appear on the display screen, causing immersive output to change.

8. The method of claim 7, further comprising changing video output shown on the display screen based on the each person'"'"'s interaction with at least one of the images.

9. The method of claim 7, further comprising providing an electronic record of a license right to digital content to a user account data store associated with the each person, based the each person'"'"'s interaction with at least one of the images.

10. The method of claim 9, where the data store comprises a computer memory in an AR output device worn by the each person.

11. The method of claim 2, wherein the configuring comprises including the AR data for augmenting video data for output on the display screen.

12. The method of claim 11, further comprising including in the AR data code for managing a transition between AR output produced from the AR data by an AR output device and video output shown on the display screen, based at least in part on a geometry of the display screen and a relative position of each person viewing AR output on one of the multiple immersive output devices.

13. The method of claim 2, wherein the configuring comprises including the VR data for augmenting video data for output on the display screen.

14. The method of claim 13, further comprising playing the video data and the VR data at different, non-overlapping times, such that ones of the multiple individuals wearing a VR output device view content on the display screen and on a VR output device at different times.

15. The method of claim 13, wherein the video data and the VR data are configured to play contemporaneously.

16. The method of claim 2, wherein the video data comprises one of two-dimensional non-stereoscopic or stereoscopic frame data.

17. The method of claim 2, further comprising including haptic control data in the digital cinematic master data, where the haptic control data activates a haptic device in coordination with the at least one of AR data or VR data.

18. An apparatus for providing at least one of augmented reality (AR) output or a virtual reality (VR) output for a contemporaneous presentation to a co-located audience, comprising:

a processor, a memory coupled to the processor, and a stereoscopic display device coupled to the processor, wherein the memory holds instructions that when executed by the processor, cause the apparatus to perform;

communicating with multiple immersive output devices each configured for providing one of an augmented reality (AR) output or a virtual reality (VR) output based on a data signal, wherein each of the multiple immersive output devices is present within eyesight of a display screen;

configuring the data signal based on digital cinematic master data that includes at least one of VR data or AR data; and

transmitting the data signal to the multiple immersive output devices contemporaneously.

19. A method comprising:

configuring digital cinematic master data that includes at least one of augmented reality (AR) data or virtual reality (VR) data for providing one of an AR output or a VR output comprising a cinematic presentation contemporaneously with output for display on a 2D screen; and

recording the digital cinematic master data in a non-transitory computer-readable medium.

20. The method of claim 19, wherein the configuring comprises preparing the AR data for augmenting video data configured for projection or output on the 2D display screen arranged for viewing by multiple individuals.