Systems and methods of displaying virtual elements on a multipositional display

• US 11,538,442 B2
• Filed: 04/13/2018
• Issued: 12/27/2022
• Est. Priority Date: 04/13/2018
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Gurr, Kae-Ling Jacquline, Kim, Young Soo, Whitaker, Ryan Eugene, Woo, Aaron Naoyoshi Sheung Yan, Mamaril, Bryan Kim
• Primary Examiner(s): Bukowski, Kenneth
• Application Number:
  US15/953,122
• Publication Number:
  US 20190318710A1
• Time in Patent Office: 1,719 Days
• CPC Class Codes: F16M 11/046 adapted to upward-downward translation movement
• CPC Class Codes: F16M 11/105 the horizontal axis being the roll axis, e.g. for creating a landscape-portrait rotation
• CPC Class Codes: F16M 11/22 with approximately constant height, e.g. with constant length of column or of legs F16M11/42 takes precedence
• CPC Class Codes: F16M 2200/041 for balancing rotational movement of the head
• CPC Class Codes: F16M 2200/047 for balancing translational movement of the head
• CPC Class Codes: G06F 1/1601 Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays constructional details related to flat displays integrated in a portable computer, e.g. laptop, handheld computer G06F1/1637; constructional details related to television receivers H04N5/64
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1631 Panel PC, e.g. single housing hosting PC and display panel
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G09G 2340/0442 Handling or displaying different aspect ratios, or changing the aspect ratio
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/0492 Change of orientation of the displayed image, e.g. upside-down, mirrored
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/373 for modifying the size of the graphic pattern
• CPC Class Codes: G09G 5/38 with means for controlling the display position

Abstract

A method of presenting visual information to a user includes detecting a position of a display relative to a surrounding environment, detecting movement of the display relative to the surrounding environment in real time, and updating a present of visual information on the display relative to a virtual reference frame updated in real time based upon the movement of the display relative to the surrounding environment.

Claims

1. A method of presenting visual information to a user, the method comprising:

detecting a first position of a display relative to a surrounding environment;

detecting in real time rotation of the display about a fixed base from the first position toward a second position, the detected rotation relative to the surrounding environment;

during the detected rotation, repeatedly updating an orientation of dynamic visual information displayed on the display, the updating occurring in real time based upon the rotation of the display relative to the surrounding environment, wherein upon completion of rotation the displayed objects have not changed from an original location such that the display appears to a user as a window into a virtual or remote environment; and

during the detected rotation, providing a torque in the direction of the rotation at a first stage, and providing a dampening torque with a dampening device against the direction of the rotation at a second stage, the dampening torque being relative to a rate of movement of the display.

2. The method of claim 1, where real time is at least 10 Hz.

3. The method of claim 1, detecting a position of the display including identifying one or more objects in the surrounding environment with at least one camera.

4. The method of claim 1, detecting a position of the display including measuring a direction of gravity with an accelerometer.

5. The method of claim 1, detecting movement of the display including detecting rotation of the display with a gyroscope positioned in a housing of the display.

6. The method of claim 1, detecting movement of the display including detecting rotation of the display by measuring changes in a direction of gravity with an accelerometer.

7. The method of claim 1, detecting movement of the display including recognizing at least one user with a camera.

8. The method of claim 1, updating the presentation of visual information on the display including rotating and translating the visual information an equal and opposite amount to detected movement of the display relative to the surrounding environment.

9. The method of claim 1, repeatedly updating the display of visual information further including repeatedly changing a height of two or more windows of the visual information and a width of the two or more windows of the visual information.

10. The method of claim 9, repeatedly updating the display of visual information further including repeatedly moving or resizing at least one virtual element based on a change to the height or the width of the two or more windows.

11. The method of claim 1, wherein the dynamic visual information is changing.

12. A system for presenting visual information to a user, the system comprising:

a display;

a fixed base;

a connection mechanism that allows rotation of the display relative to the fixed base, wherein the connection mechanism is configured to provide a torque in the direction of rotation;

a dampening device configured to provide a dampening torque opposite the torque in the direction of rotation to limit a rotational rate of the connection mechanism, the dampening torque being relative to a rate of movement of the display;

at least one orienting device configured to detect an orientation of the display; and

a computing device in communication with the display and the at least one orienting device, the computing device including a microprocessor and a hardware storage device having instructions stored thereon that when executed by the microprocessor cause the computing device to;

receive at least one of a translation or rotation information from the at least one orienting device regarding position of the display;

calculate at least one of a reference frame translation or rotation of a remote virtual environment, wherein the reference frame is fixed relative to gravity;

rotate or translate a reference frame of the remote virtual environment according to the calculated at least one of the reference frame translation or rotation; and

display at least one of a rotated or translated virtual environment with the display while the display is between the landscape and the portrait configuration within the same plane.

13. The system of claim 12, the computing device being positioned in a housing with the display.

14. The system of claim 12, the instructions further including not moving at least one virtual element within a window of the remote virtual environment displayed on the rotated and translated remote virtual environment.

15. The system of claim 12, the remote virtual environment imaged through a camera of a remote computing device.

16. The system of claim 12, wherein the fixed base is moveable relative to the ground.

17. The system of claim 16, wherein the fixed base is a rolling cart.

18. The system of claim 12, wherein the remote virtual environment is a video conference imaged by a camera of a remote computing device.

19. The system of claim 12, the computing device remaining stationary while the display moves between the landscape configuration and the portrait configuration.

20. A system for presenting visual information to a user, the system comprising:

a display;

a fixed base;

a connection mechanism that couples rotation of the display relative to the fixed base and translation of the display relative to the base;

a dampening device configured to limit rotational rate of the connection mechanism, wherein the dampening device is further configured to provide a dampening torque that is relative to the rate of movement of the connection mechanism;

at least one orienting device configured to detect an orientation of the display; and

a computing device in communication with the display and the at least one orienting device, the computing device including a microprocessor and a hardware storage device having instructions stored thereon that when executed by the microprocessor cause the computing device to;

receive rotation and translation information from the at least one orienting device regarding position of the display, the translation or rotation information corresponding to a position of the display between a landscape and a portrait configuration in a same plane;

calculate a reference frame rotation and translation of a virtual environment;

rotate and translate a reference frame of the virtual environment according to the calculated reference frame translation and rotation; and

display a rotated and translated virtual environment with the display while the display is between the landscape and the portrait configuration in the same plane.

21. The system of claim 20, the at least one orienting device including a first orienting device configured to measure rotation of the display and a second orienting device configured to measure translation of the display.

22. The system of claim 20, the reference frame having an origin that coincides with a pivot point of the display in a landscape mode.

23. The system of claim 20, the instructions including receiving rotation and translation information at a detection rate that is at least a refresh rate of the display.

24. The system of claim 23, the detection rate being at least 60 Hz.

25. The system of claim 20, the instructions further including moving at least one component of a user interface relative to the reference frame of the remote virtual environment upon rotation of the reference frame.

26. The system of claim 20, wherein the fixed base is moveable relative to the ground.

27. The system of claim 26, wherein the fixed base is a rolling cart.