Sharing in an augmented and/or virtual reality environment

• US 10,484,508 B2
• Filed: 02/13/2019
• Issued: 11/19/2019
• Est. Priority Date: 05/05/2016
• Status: Active Grant

• Current Assignee: Google Inc. (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Clement, Manuel Christian, Welker, Stefan
• Primary Examiner(s): Sasinowski, Andrew
• Application Number:
  US16/274,898
• Publication Number:
  US 20190182355A1
• Time in Patent Office: 279 Days
• CPC Class Codes: A63F 13/428 involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
• CPC Class Codes: A63F 13/573 using trajectories of game objects, e.g. of a golf ball according to the point of impact
• CPC Class Codes: A63F 2300/8082 Virtual reality
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality

Abstract

In a system and method for sharing items in an augmented and/or virtual reality environment, selected virtual items may be virtually propelled using, for example, a tossing or throwing motion, to a target recipient, so that the selected item may be shared with the target recipient without direct physical and/or virtual contact with the target recipient. Movement of a user'"'"'s hand may be detected and tracked, so that the intended target recipient for the shared item may be identified based on a projected trajectory of a throwing motion of the user'"'"'s hand. Associations between the user and different target recipients may cause different possible target recipients to exhibit different attractive forces, or different levels of magnetism, for particular items being tossed or thrown by a user for sharing, to further differentiate between the possible target recipients, and resolve recipient ambiguity.

Claims

1. A computer-implemented method, comprising:

receiving, by a processor of a computing device operating in an ambient environment, a selection of a virtual item displayed in a shared virtual environment by a selection device in virtual contact with the selected virtual item;

projecting a virtual trajectory for movement of the selected virtual item based on a detected movement of the selection device in virtual contact with the selected virtual item by a first user interacting in the shared virtual environment;

identifying a target recipient for the selected virtual item in the ambient environment, the target recipient corresponding to a second user in the ambient environment and interacting in the shared virtual environment, the identifying the target recipient including;

detecting at least one possible recipient in the ambient environment;

detecting an attractive force associated with each of the at least one possible recipient in the ambient environment; and

identifying the target recipient based on the projected virtual trajectory for the movement of the selected virtual item and the detected attractive force associated with each of the at least one possible recipient; and

sharing the selected virtual item, selected from the shared virtual environment, with the identified target recipient in the ambient environment.

2. The method of claim 1, wherein sharing the selected virtual item includes:

superimposing a virtual image of the selected virtual item on the identified target recipient; and

displaying an image of the selected virtual item superimposed on the identified target recipient for viewing by the first user and the second user.

3. The method of claim 1, wherein sharing the selected virtual item includes suggesting the selected virtual item to the identified target recipient for consideration by the identified target recipient.

4. The method of claim 1, wherein sharing the selected virtual item includes sharing purchase information for the selected virtual item with the identified target recipient.

5. The method of claim 1, wherein

receiving the selection of the virtual item includes receiving a selection of a virtual event, and

sharing the selected virtual item includes sharing access to the selected virtual event with the identified target recipient.

6. The method of claim 1, wherein

detecting at least one possible recipient includes detecting a plurality of possible recipients, and

detecting the attractive force includes detecting the attractive force associated with each of the plurality of possible recipients.

7. The method of claim 6, further comprising tracking movement of the selection device in virtual contact with the selected virtual item, including:

tracking a six degree of freedom movement of a hand of the first user through a throwing movement of the hand of the user;

projecting the virtual trajectory for the selected virtual item based on the tracked throwing movement of the hand of the first user; and

identifying the intended target recipient based on an extension of the projected virtual trajectory to one of a plurality of possible recipients.

8. The method of claim 7, wherein detecting the attractive force includes detecting the attractive force based on a commonality between a characteristic of the selected virtual item and a characteristic of each of the plurality of possible recipients including detecting at least one of:

an existing association with one or more of the plurality of possible recipients;

an existing share request from one or more of the plurality of possible recipients;

a sharing history with one or more of the plurality of possible recipients;

or

a common format type with one or more of the plurality of possible recipients.

9. The method of claim 7, wherein

identifying the target recipient from the plurality of possible recipients in the shared virtual environment includes identifying the target recipient from a plurality of additional users in the shared virtual environment;

and

detecting the attractive force associated with each of the plurality of possible recipients in the shared virtual environment includes detecting the attractive force associated with each possible recipient based on at least one of;

an established association between the user and the possible recipient;

or

a request for sharing of the content of the virtual item by the possible recipient.

10. The method of claim 1, wherein identifying the target recipient includes identifying the target recipient from a plurality of virtual display areas in the shared virtual environment, each of the plurality of virtual display areas being configured to receive a virtual item for display, the method further comprising:

detecting the attractive force associated with each of the plurality of display areas based on a comparison of at least one characteristic of the selected virtual item and at least one characteristic of the respective virtual display area, the at least one characteristic of the respective virtual display area including at least one of a virtual size of the virtual display area, a virtual orientation of the virtual display area, or a virtual texture of the of the virtual display area;

identifying a target display area of the plurality of virtual display areas as the target recipient for display of the selected virtual item based on the projected virtual trajectory for the selected virtual item and the attractive force associated with each of the plurality of virtual display areas; and

displaying content of the selected virtual item at the target display area identified as the target recipient.

11. The method of claim 10, wherein displaying the content of the selected virtual item at the target display area identified as the target recipient includes at least one of:

re-sizing a virtual item previously displayed at the target display area identified as the target recipient to accommodate display of the selected virtual item at the target display area identified as the target recipient;

or

eliminating a virtual item previously displayed at the target display area identified as the target recipient to accommodate display of the selected virtual item at the target display area identified as the target recipient.

12. The method of claim 1, wherein identifying the target recipient includes identifying the target recipient from a plurality of virtual storage areas in the shared virtual environment, each of the plurality of virtual storage areas being configured to receive a virtual item for storage, the method further comprising:

detecting the respective attractive force associated with each of the plurality of virtual storage areas based on a comparison of at least one characteristic of the selected virtual item and at least one characteristic of the respective virtual storage area, the at least one characteristic of the respective virtual storage area including at least one of an item classification type, a share setting, or a designated destination;

identifying a target storage area of the plurality of virtual storage areas to receive the selected virtual item based on the projected virtual trajectory for the selected virtual item and the respective attractive force associated with each of the plurality of virtual storage areas; and

sharing the content of the selected virtual item in the target storage area identified as the target recipient.

13. A computer-implemented method, comprising:

receiving, by a processor of a computing device operating in an ambient environment, a selection of a virtual item displayed in a shared augmented reality environment by a selection device in virtual contact with the selected virtual item, the selected virtual item representing a virtual event;

projecting a virtual trajectory for movement of the selected virtual item based on a detected movement of the selection device in virtual contact with the selected virtual item by a first user in the ambient environment, interacting in the shared augmented reality environment;

identifying a target recipient for the selected virtual item in the shared augmented reality environment, the target recipient corresponding to a second user in the ambient environment, interacting in the shared augmented reality environment, the identifying the target recipient including;

detecting at least one possible recipient in the shared augmented reality environment;

identifying the target recipient based on the projected virtual trajectory for the movement of the selected virtual item and an attractive force associated with the at least one possible recipient; and

sharing access to the selected virtual event represented by the selected virtual item with the identified target recipient.

14. The method of claim 13, wherein

detecting the at least one possible recipient includes detecting the at least one possible recipient from a plurality of possible recipients in the shared augmented reality environment, and

identifying the target recipient includes identifying the target recipient based on the projected virtual trajectory and the respective attractive forces associated with each of the plurality of possible recipients in the shared augmented reality environment.

15. The method of claim 14, wherein identifying the target recipient includes detecting the attractive forces associated with each of the plurality of possible recipients based on at least one of:

an established association between the first user and each of the plurality of possible recipients;

a request for sharing of the content of the virtual item received by the first user from one or more of the plurality of possible recipients;

or

a sharing history of the first user with one or more of the plurality of possible recipients.

16. The method of claim 14, further comprising tracking movement of the selection device in virtual contact with the selected virtual item, including:

tracking a six degree of freedom movement of a hand of the first user through a throwing movement of the hand of the user;

projecting the virtual trajectory for the selected virtual item based on the tracked throwing movement of the hand of the first user; and

identifying the intended target recipient based on an extension of the projected virtual trajectory to one of a plurality of possible recipients.

17. A computer-implemented method, comprising:

receiving, by a processor of a computing device operating in an ambient environment, a selection of a virtual item displayed in a shared augmented reality environment by a selection device in virtual contact with the selected virtual item;

projecting a virtual trajectory for movement of the selected virtual item based on a detected movement of the selection device in virtual contact with the selected virtual item by a first user in the ambient environment, interacting in the shared augmented reality environment;

identifying a target recipient for the selected virtual item in the shared augmented reality environment, the target recipient corresponding to a second user interacting in the shared augmented reality environment, the identifying the target recipient including;

detecting at least one possible recipient in the shared environment;

identifying the target recipient based on the projected virtual trajectory for the movement of the selected virtual item and an attractive force associated with the at least one possible recipient; and

sharing the selected virtual item, selected from the shared augmented reality environment, with the identified target recipient, including sharing content associated with the selected virtual item for further action by the identified target recipient.

18. The method of claim 17, wherein sharing the content associated with the selected virtual item includes at least one of:

superimposing a virtual image of the selected virtual item on the identified target recipient;

suggesting the selected virtual item to the identified target recipient for consideration by the identified target recipient;

or

sharing purchase information for the selected virtual item with the identified target recipient.