Enabling authentication and/or effectuating events in virtual environments based on shaking patterns and/or environmental information associated with real-world handheld devices

• US 9,361,448 B2
• Filed: 09/11/2014
• Issued: 06/07/2016
• Est. Priority Date: 06/21/2012
• Status: Active Grant

• Current Assignee: ETH Zurich, Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Gross, Thomas R., Mangold, Stefan, Frigg, Roman
• Primary Examiner(s): ALAM, MIRZA F
• Application Number:
  US14/483,213
• Publication Number:
  US 20150013004A1
• Time in Patent Office: 635 Days
• Field of Search: 340/5.2, 340/407.1, 340/407.2, 340/7.6, 340/7.61, 340/815.4, 340/425.5, 340/691.6, 345/156, 345/158, 345/173, 345/178, 345/419, 345/653, 345/664, 463/1, 463/31, 463/32, 463/40, 463/42
• US Class Current: 1/1
• CPC Class Codes: G06F 21/36 by graphic or iconic representation
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: H04W 12/06 Authentication
• CPC Class Codes: H04W 12/50 Secure pairing of devices
• CPC Class Codes: H04W 12/68 Gesture-dependent or behaviour-dependent

Abstract

Shaking patterns and/or environmental information associated with real-world handheld devices may form a basis for enabling authentication and/or effectuating events in a virtual environment. The handheld devices may include toys and/or other object that can be used to play. The handheld devices may be associated with the virtual environment in that individual handheld devices may share an appearance and/or theme with an avatar, a virtual object, and/or other element within the virtual environment. Shaking a pair of handheld devices together may facilitate authentication of the handheld devices with respect to the virtual environment and/or effectuate one or more events within the virtual environment. Shake patterns may be used in conjunction with geo-location and/or environmental information to improve pairing between handheld devices.

Claims

1. A system configured to authenticate one or both of a user or a real-world handheld device with respect to a virtual environment based on one or more of shaking patterns, geolocations, or environmental information associated with one or more real-world handheld devices, the system comprising:

one or more non-transitory computer-readable storage media; and

one or more processors configured by computer program instructions embodied on the one or more storage media to;

determine whether a first handheld device and a second handheld device have been shaken together based on one or more of;

(1) information conveyed by one or more shake signals describing respective shaking motions associated with the first and second handheld devices, a given shake signal associated with a given handled device being provided by a motion detection apparatus disposed within the given handled device, the motion detection apparatus being configured to provide the given shake signal responsive to the given handheld device undergoing a shaking motion caused by a user;

(2) geo-location information respectively associated with the first and second handheld devices;

or

(3) environmental information respectively associated with the first and second handheld devices; and

authenticate one or both of the user or the first handheld device with respect to the virtual environment based on information associated with a user-generated shaking motion of individual handheld devices, wherein one or both of the user or the first handheld device is authenticated with respect to the virtual environment responsive to a positive determination that the first handheld device and the second handheld device were shaken together.

2. The system of claim 1, wherein the first handheld device is a toy.

3. The system of claim 1, wherein a form factor of the first handheld device visually represents a first avatar or a first virtual object included in the virtual environment.

4. The system of claim 1, wherein the information associated with the shaking motion of the first handheld device includes a shake pattern configured to be interpreted as a unique first encryption key associated with the first handheld device.

5. The system of claim 1, wherein an action is effectuated in the virtual environment responsive to the authentication.

6. The system of claim 5, wherein the action includes one or both of:

an interaction in the virtual environment between a first avatar associated with the first handheld device and a second avatar associated with the second handheld device;

or

a first virtual object associated with the first handheld device being obtained in the virtual environment by a second avatar associated with the second handheld device.

7. The system of claim 1, wherein the one or more processors are further configured by the computer program instructions to determine whether the first handheld device and the second handheld device have been shaken together by correlating the information associated with respective user-generated shaking motions associated with the first and second handheld devices.

8. The system of claim 7, wherein the information associated with respective user-generated shaking motions associated with the first and second handheld devices includes a first shake pattern and a second shake pattern each including a range of frequencies, and wherein the shake pattern correlation sub-component is configured to extract frequency bands from the first and second shake patterns that correspond to typical user-generated shaking movements.

9. The system of claim 7, wherein the one or more processors are further configured by the computer program instructions to (1) divide the first and second shake patterns into a plurality of overlapping segments, (2) determine maximum absolute values of a cross-correlation for individual pairs of corresponding segments, and (3) determine a similarity measure between the first and second shake patterns as the mean of the maximum absolute values of the cross-correlation for individual pairs of corresponding segments.

10. The system of claim 1, wherein the one or more processors are further configured by the computer program instructions to determine whether the first handheld device and the second handheld device have been shaken together by correlating the geo-location respectively associated with the first and second handheld devices.

11. The system of claim 1, wherein the one or more processors are further configured by the computer program instructions to determine whether the first handheld device and the second handheld device have been shaken together by correlating the environmental information respectively associated with the first and second handheld devices.

12. The system of claim 11, wherein the information associated with the environment of a given handheld device includes one or more of acoustic information, optical information, or temperature information obtained in the environment of the given handheld device.

13. The system of claim 1, wherein the one or more processors are further configured by the computer program instructions to perform one or both of establishing or managing relationships between one or both of users or user characters within the virtual environment, wherein a relationship between a first avatar associated with the first handheld device and a second avatar associated with the second handheld device is established in the virtual environment responsive to a positive determination that the first handheld device and the second handheld device were shaken together.

14. A computer-implemented method for authenticating one or both of a user or a real-world handheld device with respect to virtual environment based on one or more of shaking patterns, geolocations, or, environmental information associated with real-world handheld devices, the method being implemented in a computer system comprising one or more processors configured to execute computer program instructions, the method comprising:

determining, using one or more processors, to execute computer program instructions embodied on one or more non-transitory computer-readable storage media, whether a first handheld device and a second handheld device have been shaken together based on one or more of;

(1) information conveyed by one or more shake signals describing respective shaking motions associated with the first and second handheld devices, a given shake signal associated with a given handled device being provided by a motion detection apparatus disposed within the given handled device, the motion detection apparatus being configured to provide the given shake signal responsive to the given handheld device undergoing a shaking motion caused by a user;

(2) geo-location information respectively associated with the first and second handheld devices;

or

(3) environmental information respectively associated with the first and second handheld devices; and

authenticating, using one or more processors to execute computer program instructions embodied on one or more non-transitory computer-readable storage media, one or both of the user or the first handheld device with respect to the virtual environment based on information associated with a user-generated shaking motion of individual handheld devices, wherein one or both of the user or the first handheld device is authenticated with respect to the virtual environment responsive to a positive determination that the first handheld device and the second handheld device were shaken together.

15. The method of claim 14, wherein an action is effectuated in the virtual environment responsive to the authentication.

16. The method of claim 15, wherein the action includes one or both of:

an interaction in the virtual environment between a first avatar associated with the first handheld device and a second avatar associated with the second handheld device;

or

a first virtual object associated with the first handheld device being obtained in the virtual environment by a second avatar associated with the second handheld device.

17. The method of claim 14, wherein determining whether the first handheld device and the second handheld device have been shaken together includes extracting frequency bands from a first shake pattern and a second shake pattern that correspond to typical user-generated shaking movements, the first and second shake patterns being descriptive of the respective shaking motions associated with the first and second handheld devices.

18. The method of claim 14, wherein determining whether the first handheld device and the second handheld device have been shaken together includes (1) dividing the first and second shake patterns into a plurality of overlapping segments, (2) determining maximum absolute values of a cross-correlation for individual pairs of corresponding segments, and (3) determining a similarity measure between the first and second shake patterns as the mean of the maximum absolute values of the cross-correlation for individual pairs of corresponding segments.

19. The method of claim 14, wherein the information associated with the environment of a given handheld device includes one or more of acoustic information, optical information, or temperature information obtained in the environment of the given handheld device.

20. The method of claim 14, further comprising one or both of establishing or managing, using one or more processors, relationships between one or both of users or user characters within the virtual environment, wherein a relationship between a first avatar associated with the first handheld device and a second avatar associated with the second handheld device is established in the virtual environment responsive to a positive determination that the first handheld device and the second handheld device were shaken together.