Method for interacting with virtual environment using stereoscope attached to computing device and modifying view of virtual environment based on user input in order to be displayed on portion of display

• US 9,628,783 B2
• Filed: 03/17/2014
• Issued: 04/18/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: University of Southern California
• Original Assignee: University of Southern California
• Inventors: Hoberman, Perry, Bolas, Mark T., Phan, Thai
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): Towe, Joseph A
• Application Number:
  US14/216,143
• Publication Number:
  US 20140267637A1
• Time in Patent Office: 1,128 Days
• Field of Search: 348 53
• CPC Class Codes: G02B 30/36 using refractive optical elements, e.g. prisms, in the optical path between the images and the observer
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/361 Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
• CPC Class Codes: H04N 2213/001 Constructional or mechanical details

Abstract

A virtual reality hardware and software platform comprised of a stereoscope which attaches to a mobile touchscreen computer/tablet. The stereoscope, in which the user looks through, covers just the top portion of the tablet screen. This top portion displays the stereoscopic view of a virtual environment. The bottom portion displays the two-dimensional view. The user touches the view with his/her thumbs and/or fingers in order to interact with and travel through the virtual environment seen in the view.

Claims

1. A method of interacting with a virtual environment using a stereoscope attached to a display of a computing device that also functions as an input device, the display having a first portion and a second portion, the stereoscope covering the first portion but not the second portion and positioned to allow stereoscopic viewing of a view of the virtual environment, the method comprising:

displaying, on the first portion, a rendering of the virtual environment;

displaying, on the second portion, a user interface element;

receiving, from the input device, a user input based on the user interface element;

modifying, based on the user input, the virtual environment or the view of the virtual environment; and

displaying, on the first portion, a modified rendering of the virtual environment.

2. The method of claim 1, further comprising:

displaying, on the second portion, a 2D rendering of the virtual environment.

3. The method of claim 2, wherein displaying the user interface element further comprises overlaying the user interface element over the 2D rendering of the virtual environment.

4. The method of claim 2, wherein the 2D rendering includes a virtual object in the virtual environment.

5. The method of claim 1, further comprising:

producing a sound, from a speaker of the computing device, based on the modified rendering of the virtual environment.

6. The method of claim 1, further comprising:

modifying, based on the modified rendering of the virtual environment, the user interface element; and

displaying, on the second portion, the modified user interface element.

7. The method of claim 1, further comprising:

receiving, from a sensor of the computing device, a sensor data; and

modifying, based on the sensor data, the rendering of the virtual environment.

8. The method of claim 1, further comprising:

receiving, from an accelerometer of the computing device, a GPS sensor of the computing device, or a gyrometer of the computing device, an acceleration data, a geospatial data, or an orientation data; and

modifying, based on the acceleration data, the geospatial data, or the orientation data, the rendering of the virtual environment.

9. The method of claim 1, further comprising:

receiving, from a camera of the computing device, a video data; and

displaying, on the first portion, the video data and the rendering of the virtual environment.

10. The method of claim 1, further comprising:

receiving, from a microphone of the computing device, a sound data;

modifying, based on the sound data, the rendering of the virtual environment.

11. The method of claim 1, wherein the second portion comprises at least 50% of a viewable area of the display.

12. The method of claim 1 wherein:

the stereoscope is held close to eyes during at least a portion of the first recited step of displaying a rendering;

the stereoscope is held away from the eyes during at least a portion the third recited step of receiving user input; and

the stereoscope is again held close to the eyes during at least a portion of the fifth recited step of displaying a modified rendering.