INTERACTION METHOD FOR OPTICAL HEAD-MOUNTED DISPLAY

• US 20150277699A1
• Filed: 04/01/2014
• Published: 10/01/2015
• Est. Priority Date: 04/02/2013
• Status: Abandoned Application

• Current Assignee: Cherif Atia Algreatly
• Original Assignee: Cherif Atia Algreatly
• Inventors: Algreatly, Cherif Atia
• Application Number:
  US14/242,814
• Publication Number:
  US 20150277699A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A method of interaction with virtual data is disclosed. The method allows the user to select virtual data from a device display and relocate this virtual data to be stationed at a location in the air, regardless of the movement of the user. The user can move, rotate or resize the virtual window in the air. The content of the virtual window can be associated with online content such as a URL selected by the user. A group of users located in the same location or different locations, can interact with virtual data suspended in the atmosphere around them. Each one of the users can select virtual data on a device display and drag the virtual data to a desired position in mid-air. All users can view the virtual data at its new location by aiming a device display towards this location. The device can be OHMD, HMD, tablet, or mobile phone, as well as, a retinal projector.

Claims

1. A method to relocate a virtual window from a first position on a display to a second position in the air wherein the method comprising;

providing a first input representing the selection of the virtual window at the first position;

providing a second input representing the location of the second position relative to the first position, and

relocating the virtual window to appear at the second position through the display.

2. The method of claim 1 wherein the content of the virtual window is associated with online content described by a URL.

3. The method of claim 1 wherein the first input is gestures or natural language voice commands, and the second input is hand movements or device movements.

4. The method of claim 1 wherein the display is an optical head-mounted display, head-mounted display, tablet screen, mobile phone screen, or retinal projector.

5. The method of claim 1 further the virtual window can be moved, rotated, or resized in the air.

6. The method of claim 1 further the virtual window can be accessible to a group of users wherein each one of the group of users is at a different location.

7. The method of claim 1 wherein the display is an optical head-mounted display, head-mounted display, tablet screen, mobile phone screen, or retinal projector.

8. The method of claim 1 wherein the location of the second position is determined to remain the virtual window stationed at the second position regardless of the movement of the display or the user.

9. The method of claim 1 wherein the virtual window is a three-dimensional virtual object.

10. The method of claim 1 wherein the second position is a located on a real object such as a wall or piece of furniture.

11. The method of claim 10 wherein the second input is represented by pointing to the real object by a gesture.

12. The method of claim 10 further a depth sensing camera is utilized to detect the locations of the real object points relative to the position of the display.

13. A method to move a virtual window from a first position on a display to a second position in the air wherein the method comprising;

providing a first input representing the selection of the virtual window at the first position;

tilting the display to be orthogonal to the direction of the virtual window movement;

providing a second input representing the time period of the virtual window movement along the direction; and

moving the virtual window along the direction to stop at the second position at the end of the time period.

14. The method of claim 13 wherein the display is a mobile phone screen, tablet screen, optical head-mounted display, or head-mounted display.

15. The method of claim 13 wherein the second input is provided by pressing an icon presented on the display.

16. The method of claim 13 wherein the location of the second position is determined to remain the virtual window stationed at the second position regardless the movement of the display.

17. A method for creating a virtual window to be stationed at a location in the air wherein the method comprising;

providing a first input representing the location of the virtual window;

providing a second input representing the boundary lines of the virtual window;

providing a third input representing the content of the virtual window; and

presenting the content inside the boundary lines at the location to be seen through a display.

18. The method of claim 17 wherein the first input and the second input are represented by hand gestures.

19. The method of claim 17 wherein the third input is represented by writing in the air or providing natural language voice commands.

20. The method of claim 17 wherein the content of the virtual window is associated with online content described by a URL.