Immersive display with peripheral illusions

• US 9,480,907 B2
• Filed: 05/09/2013
• Issued: 11/01/2016
• Est. Priority Date: 03/02/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Perez, Gritsko, Benko, Hrvoje, Jones, Brett R., Ofek, Eyal, Wilson, Andrew
• Primary Examiner(s): Lewis, David L
• Assistant Examiner(s): HALL, SHAUNA-KAY N
• Application Number:
  US13/891,116
• Publication Number:
  US 20140051510A1
• Time in Patent Office: 1,272 Days
• Field of Search: 463/31
• US Class Current: 1/1
• CPC Class Codes: A63F 13/00 Video games, i.e. games using an electronically generated display having two or more dimensions gaming systems which provide a financial reward G07F17/32
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/213 comprising photodetecting means, e.g. cameras, photodiodes or infrared cells A63F13/219, A63F13/655 take precedence
• CPC Class Codes: A63F 13/26 having at least one additional display device, e.g. on the game controller or outside a game booth
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 2300/1093 using visible light
• CPC Class Codes: A63F 2300/301 using an additional display connected to the game console, e.g. on the controller
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: G09G 5/12 Synchronisation between the display unit and other units, e.g. other display units, video-disc players
• CPC Class Codes: H04N 7/002 Special television systems not provided for by H04N7/007 - H04N7/18 still pictures via a television channel H04N1/00098

Abstract

A primary display displays a primary image. A peripheral illusion is displayed around the primary display by an environmental display so that the peripheral illusion appears as an extension of the primary image.

Claims

1. An interactive computing system configured to provide an immersive display experience within a display environment, the system comprising:

an environmental display output configured to output a peripheral image to an environmental display;

a logic machine operatively connectable to the environmental display via the environmental display output; and

a storage machine holding instructions executable by the logic machine to output the peripheral image to the environmental display for projection as a peripheral illusion around a primary display, the peripheral illusion including a visual representation of the display environment on which the peripheral illusion is projected.

2. The interactive computing system of claim 1, wherein the peripheral illusion is masked from one or more surfaces in the display environment.

3. The interactive computing system of claim 2, wherein the one or more masked surfaces includes the primary display.

4. The interactive computing system of claim 2, wherein the one or more masked surfaces includes all surfaces except those surfaces within a threshold distance of a projection plane.

5. The interactive computing system of claim 1, wherein the visual representation includes a geometric distortion configured to cause the display environment to appear to move.

6. The interactive computing system of claim 1, wherein the visual representation includes a color distortion configured to cause a color of the display environment to appear to change.

7. The interactive computing system of claim 1, wherein the peripheral illusion includes a plurality of motion trackers synced with a changing perspective of the primary image on the primary display to enhance perception of apparent motion.

8. The interactive computing system of claim 1, wherein the peripheral illusion includes apparent lighting that extends virtual lighting of the primary image as displayed by the primary display.

9. The interactive computing system of claim 1, wherein an element of the primary image as displayed by the primary display moves from the primary image to the peripheral illusion.

10. The interactive computing system of claim 1, wherein an element of the peripheral image as projected by the environmental display moves from the peripheral illusion to the primary display.

11. The interactive computing system of claim 1, wherein the peripheral illusion includes a full color extension of the primary image.

12. The interactive computing system of claim 1, wherein the peripheral illusion includes an extension of high contrast edges of the primary image.

13. The interactive computing system of claim 1, wherein the peripheral illusion includes an extension of selected elements of the primary image.

14. The interactive computing system of claim 1, further comprising a peripheral input configured to receive a depth input from a depth camera, the depth input identifying a location of the primary display and features of display environment on which the peripheral illusion is projected, the instructions further executable by the logic machine to generate and output the peripheral illusion based at least on the depth input from the depth camera and the location of the primary display.

15. One or more storage machines holding instructions executable by one or more logic machines, the instructions configured to provide an immersive display experience within a display environment, the instructions configured to:

recognize a position of a primary display in the display environment; and

output a peripheral image to an environmental display for display as a peripheral illusion around the primary display, the peripheral illusion including a visual representation of the display environment on which the peripheral illusion is projected.

16. The storage machine of claim 15, wherein the peripheral illusion is masked from one or more surfaces in the display environment.

17. The storage machine of claim 15, wherein the one or more masked surfaces includes the primary display.

18. The storage machine of claim 15, wherein the environmental display is a see-through display and the peripheral illusion is an augmented reality image displayed by the see-through display.

19. An interactive computing system configured to provide an immersive display experience within a display environment, the system comprising:

a peripheral input configured to receive a depth input from a depth camera;

a primary display output configured to output a primary image to a primary display;

an environmental display output configured to output a peripheral image to an environmental display;

a logic machine operatively connectable to the primary display via the primary display output, to the environmental display via the environmental display output, and to the depth camera via the peripheral input; and

a storage machine holding instructions executable by the logic machine to;

determine a location of the primary display from the depth input;

output the primary image to the primary display; and

output the peripheral image to the environmental display for projection as a peripheral illusion masked from the determined location of the primary display, the peripheral illusion including a visual representation of at least a portion of the display environment on which the peripheral illusion is projected.