CONTINUED VIRTUAL LINKS BETWEEN GESTURES AND USER INTERFACE ELEMENTS

• US 20120249429A1
• Filed: 03/29/2011
• Published: 10/04/2012
• Est. Priority Date: 03/29/2011
• Status: Active Grant

• Current Assignee: Tahoe Research Limited (f/k/a Learndale Limited) (Vector Capital Corporation)
• Original Assignee: Intel Corporation
• Inventors: Anderson, Glen J., Palmer, Ryan
• Granted Patent: US 8,717,318 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A device includes a processor to receive input data from an image detector, where the input data includes data obtained from tracking air movements of a user'"'"'s body part interacting with a virtual object of the electronic display, the processor to map the input data to a control input to move the virtual object beyond the display. The device could, for example, include a mobile device such as a smartphone or a laptop. The virtual object could for example move to another display or to a bezel of the device. A touch screen sensor may allow the virtual object to be pinched from the display, before being lifted beyond the display. The processor may map the input data to control input to create a virtual binding of the virtual object in order to create a visual rendering of a connection between the virtual object and the user'"'"'s body part.

Claims

1. A device comprising an electronic display and a processor to receive input data from an image detector, the input data including data obtained from tracking air movements of a user'"'"'s body part interacting with a virtual object of the electronic display, the processor to map the input data to a control input to move the virtual object beyond the display.

2. The device of claim 1, further comprising the image detector.

3. The device of claim 1, wherein the body part is a hand or a part of a hand.

4. The device of claim 1, wherein:

the display is a first display; and

the processor is to map the input data to the control input to move the virtual object from the first display toward a second display.

5. The device of claim 4, wherein:

the device is a first device; and

the processor is to determine a proximity to the first device of a second device including the second display before mapping the input data to the control input.

6. The device of claim 4, wherein the first display has a display screen, the device further comprising a touch screen sensor coupled to the display screen, and wherein:

the input data is a second input data;

the processor is to further receive a first input data from the touch screen sensor, the first input data including data obtained from sensing interactions of a user'"'"'s body part with the virtual object on the first display; and

the processor to map both the first input data and the second input data to the control input to move the virtual object from the first display toward the second display.

7. The device of claim 6, wherein the interactions include a pinching motion of the user'"'"'s body part with respect to a location of the virtual object on the display screen of the first display, the processor to map the first input data to the control input to pinch the virtual object from the first display.

8. The device of claim 7, wherein the air movements include a releasing motion of the user'"'"'s body part with respect to target location of the virtual object on the second display, the processor to map the second input data to the control input to release the virtual object onto the second display.

9. The device of claim 6, wherein the processor is to map the first input data and the second input data to the control input to create a virtual binding of the virtual object.

10. The device of claim 9, wherein the user'"'"'s body part is the user'"'"'s first body part, the processor to receive a third input data from the image detector, the third input data including data on air movements by a second body part of the user interacting with the virtual binding on the first display, to processor to map the third input data to the control input to manipulate the virtual binding.

11. The device of claim 1, wherein the processor is to map the input data to the control input to move the virtual object from the electronic display to a bezel of the electronic device.

12. The device of claim 11, wherein the processor is to map the input data to the control input to indicate a position of the virtual object on the bezel on a map of the display.

13. A device comprising a processor to receive input data from an image detector, the input data including data obtained from tracking air movements of a user'"'"'s body part interacting with a virtual object from an electronic display of a first electronic device, the processor to map the input data to a control input to place the virtual object onto a second display of a second electronic device.

14. The device of claim 13, further including the image detector.

15. The device of claim 13, wherein the body part is a hand or a part of a hand.

16. The device of claim 13, wherein the processor is to determine a proximity to the second electronic device of the first electronic device including the first display, and to map the input data to the control input to display an optional target location of the virtual object on the second display before moving the virtual object to the second display.

17. The device of claim 13, wherein the air movements include a releasing motion of the user'"'"'s body part with respect to a target location of the virtual object on the second display.

18. The device of claim 13, wherein the input data includes data on inertial properties of the releasing motion, the processor to map the input data to the control input to determine an inertial behavior of the virtual object once on the second display.

19. A method comprising:

receiving input data from an image detector, the input data including data obtained from tracking air movements of a user'"'"'s body part interacting with a virtual object of an electronic display;

mapping the input data to a control input to move the virtual object beyond the display.

20. The method of claim 19, wherein:

the display is a first display; and

mapping includes mapping the input data to the control input to move the virtual object from the first display toward a second display.

21. The method of claim 20, wherein the electronic display is part of a first electronic device, the method further including determining a proximity to the first electronic device of a second electronic device including the second display before mapping.

22. The method of claim 20, wherein the input data is a second input data, the method further including:

receiving a first input data from a touch screen sensor, the first input data including data obtained from sensing interactions of a user'"'"'s body part with the virtual object on the first display;

mapping both the first input data and the second input data to the control input to move the virtual object from the first display toward the second display.

23. The method of claim 22, wherein:

the interactions include a pinching motion of the user'"'"'s body part with respect to a location of the virtual object on a display screen of the first display; and

mapping includes mapping the first input data to the control input to pinch the virtual object from the first display.

24. The method of claim 23, wherein:

the air movements include a releasing motion of the user'"'"'s body part with respect to a target location of the virtual object on the second display; and

mapping including mapping the second input data to the control input to release the virtual object onto the second display.

25. The method of claim 22, wherein mapping includes mapping the first input data and the second input data to the control input to create a virtual binding of the virtual object.

26. The method of claim 19, wherein mapping includes mapping the input data to the control input to move the virtual object from the electronic display to a bezel of the electronic device.

27. The method of claim 26, wherein mapping includes mapping the input data to the control input to indicate a position of the virtual object on the bezel on a map of the display.

28. The method of claim 20, wherein mapping includes mapping the input data to the control input to further place the virtual object onto the second display.

29. The method of claim 28, further including determining a proximity to the second electronic device of the first electronic device, wherein mapping includes mapping the input data to the control input to display an optional target location of the virtual object on the second display before moving the virtual object to the second display.

30. The method of claim 28, wherein the air movements include a releasing motion of the user'"'"'s body part with respect to a target location of the virtual object on the second display.

31. The method of claim 28, wherein:

the input data includes data on inertial properties of the releasing motion; and

mapping includes mapping the input data to the control input to determine an inertial behavior of the virtual object once on the second display.

32. A computer readable medium encoded with computer executable instructions, which, when accessed, cause a machine to perform operations comprising:

receiving input data from an image detector, the input data including data obtained from tracking air movements of a user'"'"'s body part interacting with a virtual object of the electronic display,

mapping the input data to a control input to move the virtual object beyond the display.

33. The computer readable medium of claim 32, wherein:

the display is a first display; and

mapping includes mapping the input data to the control input to move the virtual object from the first display toward a second display.