Virtual and augmented reality system and headset display

• US 10,499,118 B2
• Filed: 12/19/2016
• Issued: 12/03/2019
• Est. Priority Date: 04/24/2012
• Status: Active Grant

• Current Assignee: Skreens Entertainment Technologies, Inc.
• Original Assignee: Skreens Entertainment Technologies, Inc.
• Inventors: Todd, Marc
• Primary Examiner(s): Flynn, Nathan J
• Assistant Examiner(s): Somera, Caroline
• Application Number:
  US15/383,948
• Publication Number:
  US 20170105053A1
• Time in Patent Office: 1,079 Days
• Field of Search: 725110, 725153
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/25875 involving end-user authentication restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4402 involving reformatting operations of video signals for household redistribution, storage or real-time display details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764
• CPC Class Codes: H04N 21/440272 for performing aspect ratio conversion
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4753 for user identification, e.g. by entering a PIN or password cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08
• CPC Class Codes: H04N 21/4781 Games
• CPC Class Codes: H04N 21/4786 e-mailing message switching systems, e.g. electronic mail systems H04L51/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 21/4858 for modifying screen layout parameters, e.g. fonts, size of the windows
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/45 : Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

Disclosed herein are virtual reality systems and methods. An exemplary video display system includes a computerized media processor configured to receive real time video, initialize a centering mode in response to actions by a user of a virtual reality headset, display on a display screen that a centering mode is initialized, and determine a centered orientation of the user. A portion of video may be extracted from the video based on the centered orientation and combined with an informational overlay for display on the display screen.

Claims

1. A video display system comprising:

a virtual reality headset having at least one display screen; and

a media processor that is adapted to;

receive a first selected real time video in response to actions by a user of the virtual reality headset,

initialize a centering mode in response to actions by the user;

display on the at least one display screen that a centering mode is initialized;

determine a centered orientation for the user,

extract a corresponding portion of video from the first selected real-time video, wherein the corresponding portion of the first selected video corresponds to a vector of view of a user of the virtual reality headset and is based on the centered orientation,

determine an informational overlay that is relevant to the extracted portion of video based on metadata from the first selected real time video,

blend the extracted video portion of the first selected video with the informational overlay to produce a combined video wherein the overlay is overlaid on the extracted video portion, and

output the combined video in real time to the at least one display screen of the virtual reality headset.

2. The video display system of claim 1, wherein the first real time video is received by the media processor in an uncompressed state.

3. The video display system of claim 1, wherein the first selected real time video is received by the media processor in a compressed state and the media processor is adapted to decompress the first selected real time video prior to extracting the corresponding portion of video.

4. The video display system of claim 1, wherein the first selected real time video comprises data representative of a 360 degree field of view.

5. The video display system of claim 4, wherein the extracted portion of video corresponding to the first selected real time video represents a reduced field of view relative to the received first selected real time video.

6. The video display system of claim 1, further comprising a telemetry system for providing information to the media processor regarding orientation of one of the virtual reality headset and the user of the virtual reality headset.

7. The video display system of claim 6, wherein the extracted video portion of the first selected video is partially selected based on the received information from the telemetry system.

8. A video display system comprising:

a virtual reality headset having at least one display screen; and

a media processor that is adapted to;

receive a first selected real time video from a video capture device associated with a virtual reality headset and a second overlay from a different source than the video capture device;

initialize a centering mode in response to actions by a user;

display on the at least one display screen that a centering mode is initialized;

determine a centered orientation of a user of the headset,

extract a corresponding portion of video from the received first selected real time video, wherein the extracted portion of video corresponds to a vector of view of a user of the virtual reality headset and is based on the centered orientation,

determine an informational overlay that is relevant to the extracted portion of video and based on metadata from the first selected real time video,

blend the extracted video portion of the first selected video with a portion of the informational overlay to produce a combined video wherein the portion of the overlay is overlaid on the extracted video portion, and

output the combined video in real time to at the least one display screen of the virtual reality headset.

9. The video display system of claim 8, wherein the real time video received represents a field of view of approximately 180°

.