MESSAGE LOCATION BASED ON LIMB LOCATION

• US 20190295298A1
• Filed: 03/26/2018
• Published: 09/26/2019
• Est. Priority Date: 03/26/2018
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: VanBlon, Russell Speight, Mese, John Carl, Peterson, Nathan J.
• Granted Patent: US 10,643,362 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 40/107 Static hand or arm

Abstract

For presenting the message in a location of a display based on a location of a user'"'"'s limb, methods, apparatus, and systems are disclosed. One apparatus includes a display that presents a first view, a processor, and a memory that stores code executable by the processor. Here, the processor receives a first message to be presented to a user within the first view. The processor determines a location of a limb of the user relative to the first view. Moreover, the processor presents the first message in a location of the first view based on the limb location.

Claims

1. An apparatus comprising:

a display that presents a first view;

a processor; and

a memory that stores code executable by the processor to;

receive a first message to be presented to a user within the first view, wherein the first message comprises a notification;

determine a location of a limb of the user relative to the first view; and

present the first message in a location of the first view based on the limb location.

2. The apparatus of claim 1, wherein the processor presents the first message in a first location in response to the limb of the user being within the first view and presents the first message in a second location in response to the limb of the user not being within the first view, wherein the first location is within a predetermined distance of the limb, and wherein the second location is based on one of a last known limb location and an expected limb location.

3. The apparatus of claim 2, wherein the first view is an augmented reality view and the limb is a preferred hand of the user, the apparatus further comprising a camera that captures image data corresponding to the first view, wherein the processor determines whether the preferred hand of the user is within the first view using the captured image data.

4. The apparatus of claim 3, wherein the second location is near a non-preferred hand of the user.

5. The apparatus of claim 1, wherein the processor presents image data corresponding to the first view on the display, wherein the processor presents the first message along a periphery of the first view in response to the limb of the user not being within the first view.

6. The apparatus of claim 1, wherein the first message comprises one or more selection elements, said selection elements comprising one or more of:

an acknowledgement element, a reply button, a send button, and a virtual keyboard.

7. The apparatus of claim 1, wherein the processor determines whether the apparatus is operating in a stealth mode, wherein determining the location of a limb of the user relative to the first view occurs in response to determining that the apparatus is operating in a stealth mode, wherein the processor further presents the first message in a central area of the first view in response to determining that the apparatus is not operating in a stealth mode.

8. The apparatus of claim 1, wherein the processor identifies a surface near the limb location, wherein presenting the first message comprises overlaying the first message on the identified surface.

9. A method comprising:

receiving, by use of a processor, a first message to be presented to a user via a display, the display showing a first view, wherein the first message comprises a prompt;

determining a location of a limb of the user relative to the first view, the first view being one of a virtual reality view and an augmented reality view; and

displaying the first message in a location of the first view based on the limb location.

10. The method of claim 9, further comprising:

determining whether a limb of the user is within the first view;

displaying the first message in a first location in response to the limb of the user being within the first view; and

displaying the first message in a second location in response to the limb of the user not being within the first view,

wherein the first location is within a predetermined distance of the limb, and wherein the second location is based on one of a last known limb location and an expected limb location.

11. The method of claim 10, wherein the first view is an augmented reality view, wherein the limb is a dominant hand of the user, the method further comprising:

capturing image data corresponding to the first view, wherein determining whether a limb of the user is within the first view comprises determining whether the dominant hand is within the captured image data.

12. The method of claim 11, wherein the second location is near a non-dominant hand of the user.

13. The method of claim 9, further comprising displaying image data corresponding to the first view on the display, wherein displaying the first message in the location of the first view based on the limb location comprises displaying the first message along a periphery of the display in response to the limb of the user not being within the first view.

14. The method of claim 9, wherein the first message comprises one or more selection elements, said selection elements comprising one or more of:

an acknowledgement element, a reply button, a send button, and a virtual keyboard.

15. The method of claim 9, further comprising:

determining whether the display is operating in a stealth mode, wherein determining the location of a limb of the user relative to the first view occurs in response to determining that the display is operating in a stealth mode; and

displaying the first message in a central area of the display in response to determining that the display is not operating in a stealth mode.

16. The method of claim 9, further comprising:

identifying a surface near the limb location, wherein presenting the first message comprises overlaying the first message on the identified surface.

17. A program product comprising a computer readable storage medium that stores code executable by a processor, the executable code comprising code that:

receives a first message to be presented to a user via an augmented reality display, the augmented reality display showing a first view, wherein the first message comprises text;

determines whether a limb of the user is within the first view;

displays the first message in a first location of the augmented reality display in response to the limb of the user being within the first view, the first location based on a limb location; and

displays a message indication in a second location of the augmented reality display in response to the limb of the user not being within the first view.

18. The program product of claim 17, further comprising code that:

identifies a limb location in response to the limb of the user being within the first view,

wherein displaying the first message in a first location of the augmented reality display based on the limb location comprises identifying a surface near the limb location and displaying the first message on the identified surface.

19. The program product of claim 17, wherein the second location is along a periphery of the augmented reality display, wherein the first message comprises one or more of:

an acknowledgement element, a reply button, a send button, and a virtual keyboard.

20. The program product of claim 17, wherein the second location is based on a last known limb location, the program product further comprising code that:

determines that the limb is within the first view after displaying the message indication;

identifies a current limb location in response to the limb of the user being within the first view; and

displays the first message in a location of the augmented reality display based on the current limb location.