Systems and methods for providing a user interface in a field of view of a media item

• US 9,153,043 B1
• Filed: 02/16/2012
• Issued: 10/06/2015
• Est. Priority Date: 02/16/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Prada Gomez, Luis Ricardo, Wheeler, Aaron Joseph
• Primary Examiner(s): YANG, ANDREW GUS
• Application Number:
  US13/398,381
• Time in Patent Office: 1,328 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2210/12 Bounding box

Abstract

A non-transitory computer-readable medium includes instructions stored thereon for causing a display device to display a field of view of a media item and a user interface over the media item. The field of view defines a reference point and the user interface defines a perimeter. The medium also includes instructions for processing input data for controlling relative movement of one or more of the field of view, the media item, and the user interface. In addition, the medium includes instructions for causing the display device, responsive to the input data, to move the user interface relative to the field of view and the media item, provided that the reference point is within the perimeter. The medium also includes instructions for causing the display device, responsive to the input data, to move the field of view relative to the media item, provided that the reference point is outside the perimeter.

Claims

1. A non-transitory computer-readable medium having instructions stored thereon, the instructions comprising:

instructions for causing a display device to display a field of view of a media item, wherein the field of view defines a reference point and is initially positioned at a first portion of the media item, wherein the reference point is fixed with respect to the field of view, and wherein the field of view is moveable relative to the media item;

instructions for causing the display device to display a user interface over the media item, wherein the user interface is initially aligned with and at least partially viewable in the field of view at the first portion of the media item, and wherein the user interface defines a perimeter;

instructions for processing input data for controlling relative movement of one or more of the field of view, the media item, or the user interface;

instructions for causing the display device, responsive to the input data, to move the user interface relative to at least one of the field of view or the media item, provided that the reference point is within the perimeter; and

instructions for causing the display device, responsive to the input data, to move the field of view relative to the media item, provided that the reference point is outside the perimeter.

2. The non-transitory computer-readable medium of claim 1, further comprising instructions for causing the display device to fix the field of view with respect to the media item, provided that the reference point is within the perimeter.

3. The non-transitory computer-readable medium of claim 1, further comprising instructions for causing the display device, responsive to the input data, to remove the user interface and to move the field of view relative to the media item, provided that the reference point is outside the perimeter, and instructions for causing the display device, responsive to the input data and subsequent to the removal of the user interface, to display the user interface over the media item, wherein the user interface is aligned with and at least partially viewable in the field of view positioned at a second portion of the media item, provided that the field of view remains substantially stationary at the second portion of the media item.

4. The non-transitory computer-readable medium of claim 3, wherein the first and second portions of the media item are the same portion.

5. The non-transitory computer-readable medium of claim 1, wherein the user interface includes one or more menu items that are arranged within the perimeter of the user interface.

6. The non-transitory computer-readable medium of claim 5, wherein the field of view further includes a pointer associated with the reference point, and further comprising instructions for selecting a menu item of the one or more menu items in response to the input data causing movement of the pointer over the menu item.

7. The non-transitory computer-readable medium of claim 1, further comprising instructions for causing the display device, responsive to the input data, to move the user interface to its initial alignment with the field of view at the first portion of the media item, provided that the reference point is within the perimeter and the user interface is substantially stationary with respect to the field of view.

8. The non-transitory computer-readable medium of claim 1, wherein the input data includes data that represents one or more of head movement or eye movement of a user.

9. The non-transitory computer-readable medium of claim 1, wherein the display device is coupled to a wearable computer.

10. A non-transitory computer-readable medium having instructions stored thereon, the instructions comprising:

instructions for causing a display device to display a field of view of a media item, wherein the field of view defines a reference point and is initially positioned at a first portion of the media item, and wherein the field of view is moveable relative to the media item;

wherein the reference point is fixed with respect to the field of view,

instructions for causing the display device to display a user interface over the media item, wherein the user interface is initially aligned with and at least partially viewable in the field of view at the first portion of the media item, and wherein the user interface defines a perimeter;

instructions for processing input data for controlling relative movement of one or more of the field of view, the media item, or the user interface;

instructions for causing the display device, responsive to the input data, to move the field of view relative to the media item and the user interface, provided that the reference point is within the perimeter;

instructions for causing the display device, responsive to the input data, to remove the user interface and to move the field of view relative to the media item, provided that the reference point is outside the perimeter;

instructions for causing the display device, responsive to the input data and subsequent to the removal of the user interface, to display the user interface over the media item, wherein the user interface is aligned with and at least partially viewable in the field of view positioned at a second portion of the media item, provided that the field of view remains substantially stationary at the second portion of the media item.

11. The non-transitory computer-readable medium of claim 10, further comprising instructions for causing the display device to fix the user interface with respect to the media item, provided that the reference point is within the perimeter.

12. The non-transitory computer-readable medium of claim 10, further comprising instructions for causing the display device, responsive to the input data, to move the user interface relative to the media item and the field of view, provided that the reference point is within the perimeter.

13. The non-transitory computer-readable medium of claim 12, wherein the movement of the field of view relative to the media item and the user interface is in a generally opposite direction from the movement of the user interface relative to the media item and the field of view.

14. The non-transitory computer-readable medium of claim 12, wherein a rate of movement of the field of view relative to the media item is proportional to a distance of the reference point from an initial position of the reference point defined by the field of view initially positioned at the first portion of the media item.

15. The non-transitory computer-readable medium of claim 10, wherein the user interface includes one or more menu items that are arranged within the perimeter of the user interface.

16. The non-transitory computer-readable medium of claim 15, wherein the field of view further includes a pointer associated with the reference point, and further comprising instructions for selecting a menu item of the one or more menu items in response to the input data causing movement of the pointer over the menu item.

17. The non-transitory computer-readable medium of claim 10, wherein the input data includes data that represents one or more of head movement or eye movement of a user.

18. The non-transitory computer-readable medium of claim 10, wherein the display device is coupled to a wearable computer.

19. A system comprising:

a non-transitory computer-readable medium; and

program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to;

cause a display device to display a field of view of a media item, wherein the field of view defines a reference point and is initially positioned at a first portion of the media item, wherein the reference point is fixed with respect to the field of view,

cause the display device to display a user interface over the media item, wherein the user interface is initially aligned with and at least partially viewable in the field of view at the first portion of the media item, and wherein the user interface defines a perimeter,

process input data for controlling relative movement of one or more of the field of view, the media item, or the user interface,

cause the display device, responsive to the input data, to move the user interface relative to the field of view, provided that the reference point is within the perimeter,

cause the display device, responsive to the input data, to remove the user interface and to move the field of view relative to the media item, provided that the reference point is outside the perimeter, and

cause the display device, responsive to the input data and subsequent to the removal of the user interface, to display the user interface over the media item, wherein the user interface is aligned with and at least partially viewable in the field of view positioned at a second portion of the media item, provided that the field of view remains substantially stationary at the second portion of the media item.

20. The system of claim 19, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to cause the display to move the user interface relative to the field of view, while the field of view is fixed with respect to the media item, and provided that the reference point is within the perimeter.

21. The system of claim 19, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to cause the display to move the field of view relative to the media item and the user interface, while the user interface is fixed with respect to the media item, and provided that the reference point is within the perimeter.

22. The system of claim 19, further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to cause the display to move the field of view relative to the media item and the user interface, and to move the user interface relative to the media item and the field of view, provided that the reference point is within the perimeter.

23. The system of claim 22, wherein the movement of the field of view relative to the media item and the user interface is in a generally opposite direction from the movement of the user interface relative to the media item and the field of view.

24. The system of claim 22, wherein a rate of movement of the field of view relative to the media item is proportional to a distance of the reference point from an initial position of the reference point defined by the field of view initially positioned at the first portion of the media item.

25. The system of claim 19, wherein the first and second portions of the media item are the same portion.

26. The system of claim 19, wherein the user interface includes one or more menu items that are arranged within the perimeter of the user interface.

27. The system of claim 26, wherein the field of view further includes a pointer associated with the reference point, and further comprising program instructions stored on the non-transitory computer-readable medium and executable by at least one processor to select a menu item of the one or more menu items in response to the input data causing movement of the pointer over the menu item.

28. The system of claim 19, wherein the input data includes data that represents one or more of head movement or eye movement of a user.

29. The system of claim 19, further comprising a display element, a user input device, and a processor, wherein the display element and the user input device are in communication with the processor, and the processor is configured to execute one or more of the program instructions.

30. The system of claim 29, wherein the display element is configured as a wearable computer.

31. A method comprising:

instructing a display device to display a field of view of a media item, wherein the field of view defines a reference point and is initially positioned at a first portion of the media item, wherein the reference point is fixed with respect to the field of view,

instructing the display device to display a user interface over the media item, wherein the user interface is initially aligned with and at least partially viewable in the field of view at the first portion of the media item, and wherein the user interface defines a perimeter,

receiving input data for controlling relative movement of one or more of the field of view, the media item, or the user interface,

instructing the display device, responsive to the input data, to move the user interface relative to the field of view, provided that the reference point is within the perimeter,

instructing the display device, responsive to the input data, to remove the user interface and to move the field of view relative to the media item, provided that the reference point is outside the perimeter, and

instructing the display device, responsive to the input data and subsequent to the removal of the user interface, to display the user interface over the media item, wherein the user interface is aligned with and at least partially viewable in the field of view positioned at a second portion of the media item, provided that the field of view remains substantially stationary at the second portion of the media item.

32. The method of claim 31, further comprising instructing the display to move the user interface relative to the field of view, while the field of view is fixed with respect to the media item, and provided that the reference point is within the perimeter.

33. The method of claim 31, further comprising instructing the display to move the field of view relative to the media item and the user interface, while the user interface is fixed with respect to the media item, and provided that the reference point is within the perimeter.

34. The method of claim 31, further comprising instructing the display to move the field of view relative to the media item and the user interface, and to move the user interface relative to the media item and the field of view, provided that the reference point is within the perimeter.

35. The method of claim 34, wherein the movement of the field of view relative to the media item and the user interface is in a generally opposite direction from the movement of the user interface relative to the media item and the field of view.

36. The method of claim 34, wherein a rate of movement of the field of view relative to the media item is proportional to a distance of the reference point from an initial position of the reference point defined by the field of view initially positioned at the first portion of the media item.

37. The method of claim 31, wherein the first and second portions of the media item are the same portion.

38. The method of claim 31, wherein the user interface includes one or more menu items that are arranged within the perimeter of the user interface.

39. The method of claim 38, wherein the field of view further includes a pointer associated with the reference point, and further comprising selecting a menu item of the one or more menu items in response to the input data causing movement of the pointer over the menu item.

40. The method of claim 31, wherein the input data includes data that represents one or more of head movement or eye movement of a user.

41. The method of claim 31, wherein the display element is configured as a wearable computer.