SYSTEMS AND METHODS OF DISPLAYING VIRTUAL ELEMENTS ON A MULTIPOSITIONAL DISPLAY

• US 20190318710A1
• Filed: 04/13/2018
• Published: 10/17/2019
• Est. Priority Date: 04/13/2018
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: GURR, Kae-Ling Jacquline, KIM, Young Soo, WHITAKER, Ryan Eugene, WOO, Aaron Naoyoshi Sheung Yan, MAMARIL, Bryan Kim
• Granted Patent: US 11,538,442 B2
• Time in Patent Office: Days
• CPC Class Codes: F16M 11/046 adapted to upward-downward translation movement
• CPC Class Codes: F16M 11/105 the horizontal axis being the roll axis, e.g. for creating a landscape-portrait rotation
• CPC Class Codes: F16M 11/22 with approximately constant height, e.g. with constant length of column or of legs F16M11/42 takes precedence
• CPC Class Codes: F16M 2200/041 for balancing rotational movement of the head
• CPC Class Codes: F16M 2200/047 for balancing translational movement of the head
• CPC Class Codes: G06F 1/1601 Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays constructional details related to flat displays integrated in a portable computer, e.g. laptop, handheld computer G06F1/1637; constructional details related to television receivers H04N5/64
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1631 Panel PC, e.g. single housing hosting PC and display panel
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G09G 2340/0442 Handling or displaying different aspect ratios, or changing the aspect ratio
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/373 for modifying the size of the graphic pattern
• CPC Class Codes: G09G 5/38 with means for controlling the display position

Abstract

A method of presenting visual information to a user includes detecting a position of a display relative to a surrounding environment, detecting movement of the display relative to the surrounding environment in real time, and updating a present of visual information on the display relative to a virtual reference frame updated in real time based upon the movement of the display relative to the surrounding environment.

Claims

1. A method of presenting visual information to a user, the method comprising:

detecting a position of a display relative to a surrounding environment;

detecting movement of the display relative to the surrounding environment about a fixed base in real time; and

updating a presentation of visual information on the display relative to a virtual reference frame updated in real time based upon the movement of the display relative to the surrounding environment.

2. The method of claim 1, where real time is at least 10 Hz.

3. The method of claim 1, detecting a position of the display including identifying one or more objects in the surrounding environment with at least one camera.

4. The method of claim 1, detecting a position of the display including measuring a direction of gravity with an accelerometer.

5. The method of claim 1, detecting movement of the display including detecting rotation of the display with a gyroscope positioned in a housing of the display.

6. The method of claim 1, detecting movement of the display including detecting rotation of the display by measuring changes in a direction of gravity with an accelerometer.

7. The method of claim 1, detecting movement of the display including recognizing at least one user with a camera.

8. The method of claim 1, updating the presentation of visual information on the display including rotating and translating the visual information an equal and opposite amount to detected movement of the display relative to the surrounding environment.

9. The method of claim 1, updating the presentation of visual information further including changing a height of two or more windows of the visual information and a width of the two or more windows of the visual information.

10. The method of claim 9, updating a presentation of visual information further including moving or resizing at least one virtual element based on a change to the height or the width of the two or more windows.

11. A system for presenting visual information to a user, the system comprising:

a display;

a fixed base;

a connection mechanism that allows rotation of the display relative to the fixed base;

at least one orienting device configured to detect an orientation of the display; and

a computing device in communication with the display and the at least one orienting device, the computing device including a microprocessor and a hardware storage device having instructions stored thereon that when executed by the microprocessor cause the computing device to;

receive at least one of a translation or rotation information from the at least one orienting device regarding position of the display;

calculate at least one of a reference frame translation or rotation of a virtual environment;

rotate and translate a reference frame of the virtual environment according to the calculated reference frame translation and rotation; and

display a rotated and translated virtual environment with the display.

12. The system of claim 11, the computing device being positioned in a housing with the display.

13. The system of claim 11, the instructions further including moving at least one virtual element within a window of the virtual environment displayed on the rotated and translated virtual environment.

14. The system of claim 11, the virtual environment being a remote environment imaged through a camera of a remote computing device.

21. The system of claim 11, wherein the fixed base is moveable relative to the ground.

22. The system of claim 21, wherein the fixed base is a rolling cart.

15. A system for presenting visual information to a user, the system comprising:

a display;

a fixed base;

a connection mechanism that couples rotation of the display relative to the fixed base and translation of the display relative to the base;

at least one orienting device configured to detect an orientation of the display; and

a computing device in communication with the display and the at least one orienting device, the computing device including a microprocessor and a hardware storage device having instructions stored thereon that when executed by the microprocessor cause the computing device to;

receive rotation and translation information from the at least one orienting device regarding position of the display;

calculate a reference frame rotation and translation of a virtual environment;

rotate and translate a reference frame of the virtual environment according to the calculated reference frame translation and rotation; and

display a rotated and translated virtual environment with the display.

16. The system of claim 15, the at least one orienting device including a first orienting device configured to measure rotation of the display and a second orienting device configured to measure translation of the display.

17. The system of claim 15, the reference frame having an origin that coincides with a pivot point of the display in a landscape mode.

18. The system of claim 15, the instructions including receiving rotation and translation information at a detection rate that is at least a refresh rate of the display.

19. The system of claim 18, the detection rate being at least 60 Hz.

20. The system of claim 15, the instructions further including moving at least one component of a user interface relative to the reference frame of the virtual environment upon rotation of the reference frame.

23. The system of claim 15, wherein the fixed base is moveable relative to the ground.

24. The system of claim 23, wherein the fixed base is a rolling cart.