Virtual window in head-mountable display

• US 9,195,306 B2
• Filed: 10/30/2014
• Issued: 11/24/2015
• Est. Priority Date: 07/14/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Gomez, Luis Ricardo Prada
• Primary Examiner(s): DINH, DUC Q
• Application Number:
  US14/528,889
• Publication Number:
  US 20150049018A1
• Time in Patent Office: 390 Days
• Field of Search: 345 11- 13, 345/169, 345/156, 345 7- 9
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP

Abstract

Methods and systems involving a virtual window in a head-mounted display (HMD) are disclosed herein. An exemplary system may be configured to: (i) receive head-movement data that is indicative of head movement; (ii) cause an HMD to operate in a first mode in which the HMD is configured to: (a) simultaneously provide a virtual window and a physical-world view in the HMD; (b) display, in the virtual window, a portion of a media item that corresponds to a field of view; (c) determine movement of the field of view; and (d) update the portion of the media item that is displayed in the virtual window; (iii) receive mode-switching input data and responsively cause the HMD to switch between the first mode and a second mode; and (iv) responsive to the mode-switching input data, cause the HMD to operate in the second mode.

Claims

1. A head-mountable device comprising:

a see-through display;

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to;

receive head-movement data that is indicative of head movement;

cause the head-mountable device (HMD) to operate in a first mode in which the HMD is configured to;

(a) simultaneously provide a virtual window in the see-through display of the HMD and a physical-world view;

(b) display, in the virtual window, a portion of a media item that corresponds to a field of view, wherein the field of view is moveable in a substantially continual manner throughout the media item;

(c) determine, based on the head-movement data, movement of the field of view; and

(d) update the portion of the media item that is displayed in the virtual window according to the determined movement of the field of view; and

receive mode-switching input data and responsively cause the HMD to switch from operation in the first mode to operate in a second mode in which the HMD is configured to;

(e) display a selection icon and a specific portion of the media item in the virtual window, wherein the specific portion of the media item that is displayed corresponds to the field of view at or near receipt of the mode-switching input data, and wherein the virtual window is locked to the specific portion of the media item in response to the receipt of the mode-switching input data;

(f) determine, based on the head-movement data, movement of the selection icon within the virtual window; and

(g) move the selection icon as determined within the virtual window, while the specific portion of the media item is displayed.

2. The head-mountable device of claim 1, wherein the HMD further comprises a side-mounted touchpad interface.

3. The head-mountable device of claim 1, wherein the first mode is a virtual-navigation mode and the second mode is a virtual-selection mode.

4. The head-mountable device of claim 1, wherein the see-through display is arranged so as to obstruct only a portion of the physical-world view when the head-mountable device is worn.

5. The head-mountable device of claim 1, wherein the virtual window is overlaid on a portion of a physical-world window that is also displayed in the see-through display of the HMD, wherein the physical-world window provides the physical-world view via a graphic representation of a user'"'"'s field-of-view.

6. The head-mountable device of claim 1, wherein the HMD comprises a waveguide display, and wherein the virtual window is displayed in at least a portion of the waveguide display.

7. The head-mountable device of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

receive data comprising a selection indication; and

responsive to the selection indication, initiate a selection action at a current location of the selection icon.

8. The head-mountable device of claim 7, wherein the data comprising the selection indication is associated with a predetermined gesture, wherein the predetermined gesture comprises at least one of:

(a) a predetermined gesture on a touchpad interface and (b) a stop-and-stare user gesture detected in a point-of-view video associated with the HMD.

9. The head-mountable device of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to cause the HMD to cease display of the virtual window in the second mode.

10. The head-mountable device of claim 1, wherein the virtual window is of a first size, wherein the media item is of a second size, and wherein the first size is smaller than the second size.

11. The head-mountable device of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

receive data comprising a first adjustment instruction;

in response to the first adjustment instruction, initiate a resize action, wherein the resize action comprises a size adjustment to the virtual window and a size adjustment to the media item such that the field of view remains substantially the same;

receive data comprising a second adjustment instruction;

in response to the second adjustment instruction, initiate a virtual-window zoom action, wherein the virtual-window zoom action comprises an adjustment to size of the virtual window such that the field of view is adjusted;

receive data comprising a third adjustment instruction; and

in response to the third adjustment instruction, initiate a media-item zoom action, wherein the media-item zoom action comprises an adjustment to size of the media item such that the field of view is adjusted.

12. The head-mountable device of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to:

detect head-movement data indicative of substantial head movement followed by a predetermined period without substantial head movement; and

responsively cause the HMD to switch between the first mode and the second mode.

13. The head-mountable device of claim 1, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to, while in the first mode:

receive a data instruction indicating to switch to a full-screen view of the virtual window; and

responsively cease providing the virtual window and the physical-world view simultaneously and instead provide the full-screen view of the virtual window.

14. A computer-implemented method comprising:

receiving, at a head-mountable device (HMD), head-movement data that is indicative of head movement;

causing the HMD to operate in a first mode by;

(a) simultaneously providing a virtual window in a see-through display of the HMD and a physical-world view;

(b) displaying a portion of a media item in the virtual window, wherein the portion of the media item that is displayed corresponds to a field of view, wherein the field of view is moveable in a substantially continual manner throughout the media item;

(c) using the head-movement data as a basis for determining movement of the field of view within the media item; and

(d) updating the portion of the media item that is displayed in the virtual window according to the determined movement of the field of view;

receiving, by the wearable computer, mode-switching input data and responsively causing the HMD to switch from operation in the first mode to operation in a second mode by;

(e) causing a selection icon and a specific portion of the media item to be displayed in the virtual window, wherein the specific portion of the media item that is displayed corresponds to the field of view at or near receipt of the mode-switching input data, and wherein the virtual window is locked to the specific portion of the media item in response to the receipt of the mode-switching input data;

(f) determining, based on the head-movement data, movement of the selection icon within the virtual window; and

(g) moving the selection icon as determined within the virtual window while the specific portion of the media item is displayed.

15. The method of claim 14, further comprising:

causing a selection icon to be displayed in the virtual window;

determining, based on the head-movement data, movement of the selection icon within the virtual window; and

causing the selection icon to move as determined within the virtual window.

16. The method of claim 15, further comprising receiving a selection indication and responsively initiating a selection action at a current location of the selection icon.

17. The method of claim 14, further comprising, while in the second mode, causing the HMD to cease display of the virtual window.

18. A non-transitory computer-readable medium having instructions stored thereon, the instructions comprising:

instructions for receiving head-movement data that is indicative of head movement;

instructions for causing a head-mountable device (HMD) to operate in a first mode by;

(a) simultaneously providing a virtual window in a see-through display of the HMD and a physical-world view;

(b) displaying a portion of a media item in the virtual window, wherein the portion of the media item that is displayed corresponds to a field of view, wherein the field of view is moveable in a substantially continual manner throughout the media item;

(c) using the head-movement data as a basis for determining movement of the field of view within the media item; and

(d) updating the portion of the media item that is displayed in the virtual window according to the determined movement of the field of view;

instructions for receiving mode-switching input data and responsively causing the HMD to switch from operation in the first mode to operation in a second mode by;

(e) causing a selection icon and a specific portion of the media item to be displayed in the virtual window, wherein the specific portion of the media item that is displayed corresponds to the field of view at or near receipt of the mode-switching input data, and wherein the virtual window is locked to the specific portion of the media item in response to the receipt of the mode-switching input data;

(f) determining, based on the head-movement data, movement of the selection icon within the virtual window; and

(g) moving the selection icon as determined within the virtual window while the specific portion of the media item is displayed.

19. The computer-readable medium of claim 18, further comprising instructions for, while in the second mode, causing the HMD to cease display of the virtual window.