METHODS AND SYSTEMS FOR SOCIAL SHARING HEAD MOUNTED DISPLAY (HMD) CONTENT WITH A SECOND SCREEN

• US 20190294405A1
• Filed: 06/11/2019
• Published: 09/26/2019
• Est. Priority Date: 02/24/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Inventors: Watson, Brian, Mikhailov, Anton, Stafford, Jeffrey, Black, Glenn
• Granted Patent: US 10,642,566 B2
• Time in Patent Office: Days
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/27 characterised by a large display in a public venue, e.g. in a movie theatre, stadium or game arena
• CPC Class Codes: A63F 13/53 involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/86 Watching games played by other players
• CPC Class Codes: A63F 2300/538 for performing operations on behalf of the game client, e.g. rendering
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: G06T 2219/2016 : Rotation, translation, scaling

Abstract

A media streaming device is provided. In one configuration, the media streaming device includes an interface for connecting the media streaming device to a display screen. A head mounted display (HMD) output for connecting to an HMD over a wireless connection provide by wireless communication circuitry. A processor for processing received video of interactive content. The processor is configured to format the video of interactive content for rendering on the display screen. A pass-through connection that is configured to interface the video of interactive content to the HMD via the HMD output over the wireless connection. The pass-through connection maintains a left-eye and right-eye format for rendering the video of interactive content in a three-dimensional format in the HMD.

Claims

1. A video processing interface, comprising,

an input for receiving video of interactive content generated by a client system;

a head mounted display (HMD) output for connecting to an HMD;

a second screen output for connecting a display screen for rendering a view of the interactive content;

a graphics processing unit (GPU) is configured to receive the video of interactive content produced by the client system via the input, the GPU is configured to format the video of interactive content for rendering on the display screen that is connectable to the second screen output; and

a pass-through connection that is configured to receive the video of interactive content that is sent to the HMD output for delivery to the HMD, wherein the pass-through connection maintains a left-eye and right-eye format processed by the client system to render the video of interactive content in a three-dimensional format.

2. The video processing interface of claim 1, further comprising, a wireless communication circuit for communicating with the HMD via the HMD output, the wireless communication circuit is configured to deliver the video of interactive content in said three-dimensional format.

3. The video processing interface of claim 1, wherein the second screen provides a view into a scene rendered on the HMD, and the view changes based on changes in movement of the HMD.

4. The video processing interface of claim 1, further comprising,

an audio pass-through communicated between the input and the second screen output.

5. The video processing interface of claim 1, wherein the GPU includes a cropping function or a scaling function, the cropping function or scaling function used for said formatting of the video of interactive content to a screen format of the second screen.

6. The video processing interface of claim 1, further comprising,

an image process for cropping or scaling the video of interactive content to display on a screen format of the second screen.

7. The video processing interface of claim 1, further comprising,

a USB module for connecting the video processing interface to the second screen.

8. The video processing interface of claim 1, further comprising a USB module for communicating audio from the client system to a 3D audio rendering module for delivery to the HMD.

9. A media streaming device, comprising,

an interface for connecting the media streaming device to a display screen;

a head mounted display (HMD) output for connecting to an HMD over a wireless connection provide by wireless communication circuitry;

a processor for processing received video of interactive content, the processor is configured to format the video of interactive content for rendering on the display screen; and

a pass-through connection that is configured to interface the video of interactive content to the HMD via the HMD output over the wireless connection, wherein the pass-through connection maintains a left-eye and right-eye format for rendering the video of interactive content in a three-dimensional format in the HMD.

10. The media streaming device of claim 9, wherein the display screen provides a view into a scene rendered on the HMD, and the view changes based on changes in movement of the HMD.

11. The media streaming device of claim 9, wherein the processor includes a cropping function or a scaling function, the cropping function or scaling function used for said formatting of the video of interactive content to a screen format of the display screen.

12. The media streaming device of claim 9, further comprising,

an image process for cropping or scaling the video of interactive content to display on a screen format of the second screen.

13. The media streaming device of claim 9, further comprising,

a USB interface.

14. The media streaming device of claim 9, wherein the wireless communication circuitry is configured for connection to the Internet, the internet providing access to a cloud gaming service for streaming games.

15. The media streaming device of claim 9, wherein the wireless communication circuitry is configured for connection to the Internet, the internet providing access to a cloud gaming service for sharing views of the video of interactive content.