MENU NAVIGATION IN A HEAD-MOUNTED DISPLAY

• US 20150212322A1
• Filed: 05/20/2014
• Published: 07/30/2015
• Est. Priority Date: 01/25/2014
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment America LLC (Sony Group Corp.)
• Inventors: Moravetz, Justin
• Granted Patent: US 9,588,343 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A wearable computing device includes a head-mounted display (HMD) that generates a virtual reality environment. Through the generation and tracking of positional data, a focal point may be tracked with respect to one or menu navigation elements. Following the fixated positioning of the focal point over the menu navigation element for a predetermined amount of time, a process corresponding to the menu navigation element is executed.

Claims

1. A method for menu navigation in a head-mounted display, the method comprising:

generating positional data of the head-mounted display;

tracking a position of a focal point of the head-mounted display, wherein the position of the focal point is tracked within a virtual environment that includes a menu navigation element;

determining that the focal point is within an operational range of the menu navigation element;

executing a fixation timer corresponding to the navigation element, wherein the fixation timer counts down a predetermined amount of time when the focal point is within the operational range of the menu navigation element; and

implementing a corresponding function of the navigation element upon expiration of the predetermined amount of time as indicated by the fixation timer.

2. The method of claim 1, wherein generating the positional data includes processing data from a gyroscope.

3. The method of claim 1, wherein generating positional data includes processing data from an accelerometer.

4. The method of claim 1, wherein generating positional data includes processing data from a magnetometer.

5. The method of claim 1, wherein the focal point comprises an associated area around the focal point, and wherein determining that the focal point is within the operational range of the menu navigation comprises determining that the associated area is within the operational range of the menu navigation element.

6. The method of claim 1, wherein the operational range of the menu navigation element comprises an associated area around the menu navigation element, and wherein determining that the focal point is within the operational range of the menu navigation comprises determining that the focal point is within the associated area.

7. The method of claim 1, wherein the focal point and the menu navigation element each includes an associated area, and wherein determining that the focal point is within the operational range of the menu navigation comprises determining that the associated area of the focal point overlaps the associated area of the menu navigation element.

8. The method of claim 1, wherein executing the fixation timer corresponding to the navigation element comprises determining whether the focal point has moved out of the operational range since the fixation timer began execution.

9. The method of claim 8, wherein executing the fixation timer corresponding to the navigation element further comprises confirming that the focal point remains within the operational range of the menu navigation element.

10. The method of claim 8, wherein executing the fixation timer corresponding to the navigation element further comprises confirming that an area associated with the focal point remains within the operational range of the menu navigation element.

11. The method of claim 8, wherein executing the fixation timer corresponding to the navigation element further comprises confirming that an area associated with the focal point continues to overlap an area associated with the menu navigation element.

12. The method of claim 1, further comprising changing an appearance of the focal point during the execution of the timer.

13. The method of claim 1, further comprising changing an appearance of the navigation element during execution of the timer.

14. The method of claim 1, further comprising changing an appearance of an area associated with the focal point during execution of the timer.

15. The method of claim 1, further comprising changing an appearance of an area associated with the navigation element during execution of the timer.

16. The method of claim 1, further comprising changing an appearance of the focal point and the navigation element during execution of the timer.

17. The method of claim 1, further comprising changing an appearance of the focal point and an area associated with the navigation element during execution of the timer.

18. The method of claim 1, further comprising changing an appearance of an area associated with the focal point and the navigation element during execution of the timer.

19. A non-transitory computer readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for menu navigation in a head-mounted display, the method comprising:

generating positional data of the head-mounted display;

tracking a position of a focal point of the head-mounted display, wherein the position of the focal point is tracked within a virtual environment that includes a menu navigation element;

determining that the focal point is within an operational range of the menu navigation element;

executing a fixation timer corresponding to the navigation element, wherein the fixation timer counts down a predetermined amount of time when the focal point is within the operational range of the menu navigation element; and

implementing a corresponding function of the navigation element upon expiration of the predetermined amount of time as indicated by the fixation timer.

20. A system for menu navigation, the system comprising:

at least one of a gyroscope, magnetometer, and an accelerometer that generate positional data;

a head-mounted display including at least one lens to display a focal point in a virtual environment that includes a menu navigation element;

a processor that executes instructions stored in memory to;

process the positional data to track the position of the focal point within the virtual environment,

determine that the focal point is within an operational range of the menu navigation element,

execute a fixation timer corresponding to the navigation element, wherein the fixation timer counts down a predetermined amount of time when the focal point is within the operational range of the menu navigation element, and

execute a functionality associated with the menu navigation element upon expiration of the predetermined amount of time as indicated by the fixation timer.