Smart Playable Device, Gestures, and User Interfaces

• US 20180015363A1
• Filed: 10/18/2016
• Published: 01/18/2018
• Est. Priority Date: 07/13/2016
• Status: Abandoned Application

• Current Assignee: Play Impossible Corporation
• Original Assignee: Play Impossible Corporation
• Inventors: Monnin, Brian, Amit, Gadi, Langdon, Kevin
• Application Number:
  US15/296,996
• Publication Number:
  US 20180015363A1
• Time in Patent Office: Days
• CPC Class Codes: A63B 23/00 Exercising apparatus specially adapted for particular parts of the body A63B22/00 takes precedence; force-resisting aspects A63B21/00; electric or electronic controls therefor A63B24/00; devices for exercising or strengthening of fingers, or arms in teaching operation of keyboards G09B15/06
• CPC Class Codes: A63F 13/211 using inertial sensors, e.g. accelerometers or gyroscopes
• CPC Class Codes: A63F 13/235 using a wireless connection, e.g. infrared or piconet
• CPC Class Codes: A63F 13/25 Output arrangements for video game devices
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 13/92 Video game devices specially adapted to be hand-held while playing
• CPC Class Codes: A63F 2300/105 using inertial sensors, e.g. accelerometers, gyroscopes
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/80 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: H01Q 1/22 by structural association with other equipment or articles
• CPC Class Codes: H01Q 1/24 : with receiving set
• CPC Class Codes: H01Q 1/243 : with built-in antennas
• CPC Class Codes: H01Q 1/27 : Adaptation for use in or on movable bodies H01Q1/08, H01Q1/12, H01Q1/18 take precedence
• CPC Class Codes: H01Q 1/38 : formed by a conductive layer on an insulating support patch antennas H01Q9/0407; microstrip dipole antennas H01Q9/065; microstrip slot antennas H01Q13/106; transmission line microstrip antennas H01Q13/206; manufacturing reflecting surfaces using insulating material for supporting the reflecting surface H01Q15/142
• CPC Class Codes: H04L 67/306 : User profiles
• CPC Class Codes: H04M 1/72403 : with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72412 : using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/52 : including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04W 4/027 : using movement velocity, acceleration information
• CPC Class Codes: H04W 4/029 : Location-based management or tracking services
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 76/14 : Direct-mode setup

Abstract

This disclosure is generally directed to a smart playable device and systems and methods of interacting with the playable device. The playable device can include any device that is suitable for sports, games, or play, such as balls, discs, staffs, clubs, and the like. The playable device can include rapid charging circuits to receive power from a remote charger. The playable device may transmit sensor data including motion data to a computing device. Sensor data may be interpreted by the computing device as gestures of the playable device for interacting with the computing device. Sensor data can also be interpreted as motion data during gameplay and notifications can be provided to a user based on the gameplay. In some instances, the computing device can capture image data of the playable device and identify the playable device and annotate image data based on the sensor data from the playable device.

Claims

1. A computer-implemented method comprising:

establishing a wireless connection between a smart playable device and a computing device;

receiving an indication of contact charging an energy module of the smart playable device;

presenting a first menu with a plurality of selectable items on a display of the computing device;

receiving first sensor data from the smart playable device;

determining that the first sensor data corresponds to a first gesture associated with a first action;

determining that the first action is one of a first selection of a first item of the plurality of selectable items or a request to navigate to a second item of the plurality of selectable items;

receiving second sensor data from the smart playable device;

determining that the second sensor data corresponds to a second gesture associated with a second selection of a gaming application;

receiving third sensor data from the smart playable device;

determining that the third sensor data corresponds to a motion of the smart playable device; and

providing a notification via the computing device based at least in part on the third sensor data and one or more rules associated with the gaming application.

2. The computer-implemented method as recited in claim 1, wherein the notification is a first notification, the computer-implemented method further comprising:

providing a second notification on the display of the computing device, the second notification including instructions to perform a third gesture with the smart playable device;

receiving fourth sensor data from the smart playable device;

determining that the fourth sensor data corresponds to the third gesture; and

establishing the wireless connection between the smart playable device and the computing device based at least in part on the third gesture.

3. The computer-implemented method as recited in claim 1, wherein the notification is a first notification, the computer-implemented method further comprising providing a second notification of a progress of the contact charging the energy module of the smart playable device during charging of the smart playable device.

4. The computer-implemented method as recited in claim 1, wherein the first gesture is one of a tap gesture or a spin gesture.

5. The computer-implemented method as recited in claim 1, wherein the notification is a first notification, the computer-implemented method further comprising:

determining that the third sensor data includes at least first accelerometer data and second accelerometer data corresponding to an acceleration of the smart playable device and barometer data corresponding to a height of the smart playable device;

determining a speed of the smart playable device based at least in part on the first accelerometer data and the second accelerometer data;

determining a height of the smart playable device based at least in part on the barometer data;

providing a second notification including a first indication of the speed of the smart playable device; and

providing a third notification including a second indication of the height of the smart playable device.

6. The computer-implemented method as recited in claim 1, wherein the wireless connection is a first wireless connection and the notification is a first notification, the computer-implemented method further comprising:

establishing a second wireless connection between an accessory device and the computing device;

receiving fourth sensor data from the accessory device;

determining that the fourth sensor data indicates a location of the smart playable device;

determining that the location corresponds to a game event of the gaming application; and

providing a second notification via the computing device based at least in part on the game event.

7. The computer-implemented method as recited in claim 1, further comprising:

determining an identity of a user associated with the smart playable device;

determining a user profile associated with the user; and

interpreting sensor data from the smart playable device as one or more gestures based at least in part on one or more gesture preferences associated with the user profile.

8. The computer-implemented method as recited in claim 1, further comprising:

receiving fourth sensor data from the smart playable device;

determining that the fourth sensor data corresponds to a first spin gesture based on a first direction of rotation of the smart playable device occurring within a first time threshold;

receiving fifth sensor data from the smart playable device; and

determining that the fifth sensor data corresponds to a second spin gesture based on the first direction of rotation of the smart playable device and a second direction of spin of the smart playable device occurring within a second time threshold.

9. The computer-implemented method as recited in claim 1, further comprising:

accessing historical motion data associated with the gaming application, the historical motion data including at least a historical maximum height of the smart playable device resulting from a first throw during gameplay;

determining that the motion of the smart playable device corresponds to a second throw during the gameplay;

determining a height of the smart playable device associated with the motion;

determining that the height of the smart playable device is greater than the historical maximum height of the smart playable device; and

providing the notification including an indication that the height of the smart playable device is greater than the historical maximum height of the smart playable device.

10. A method comprising:

establishing a wireless connection between a smart playable device and a computing device;

presenting a menu with a plurality of selectable items on a display of the computing device;

receiving first sensor data from the smart playable device;

determining that the first sensor data corresponds to a gesture associated with an action;

determining that the action corresponds to a selection of a gaming application of a plurality of gaming applications;

providing a first notification associated with gameplay instructions associated with the gaming application;

receiving second sensor data from the smart playable device;

determining that the second sensor data corresponds to a motion of the smart playable device;

determining that the motion of the smart playable device is in accordance with at least one gaming rule associated with the gaming application; and

providing a second notification via the computing device based at least in part on the motion of the smart playable device in accordance with the at least one gaming rule.

11. The method as recited in claim 10, wherein the menu is a first menu and the plurality of selectable items is a first plurality of selectable items, the method further comprising:

determining that the first sensor data includes first accelerometer data indicating a tap gesture;

mapping the tap gesture to the selection of the gaming application;

presenting a second menu with one or more second plurality of selectable items on the display of the computing device;

receiving third sensor data from the smart playable device;

determining that the third sensor data includes second accelerometer data indicating a spin gesture;

mapping the spin gesture to a navigation from a first item of the second plurality of selectable items to a second item of the second plurality of selectable items; and

animating on the display of the computing device the navigation within the second menu.

12. The method as recited in claim 10, further comprising:

receiving third sensor data from the smart playable device;

determining that the third sensor data corresponds to a first spin gesture based on a first direction of rotation of the smart playable device occurring within a first time threshold;

receiving fourth sensor data from the smart playable device; and

determining that the fourth sensor data corresponds to a second spin gesture based on the first direction of rotation of the smart playable device and a second direction of spin of the smart playable device occurring within a second time threshold.

13. The method as recited in claim 10, further comprising:

determining an identity of a user associated with the smart playable device;

determining a user profile associated with the user; and

interpreting sensor data from the smart playable device as one or more gestures based at least in part on one or more gesture preferences associated with the user profile.

14. The method as recited in claim 10, wherein the gesture is a first gesture, the method further comprising:

receiving an indication of contact charging of an energy module of the smart playable device;

providing a third notification on the display of the computing device, the third notification including instructions to perform a second gesture with the smart playable device;

receiving third sensor data from the smart playable device;

determining that the third sensor data corresponds to the second gesture; and

establishing the wireless connection between the smart playable device and the computing device based at least in part on the second gesture.

15. The method as recited in claim 10, further comprising:

determining that the second sensor data includes at least first accelerometer data and second accelerometer data corresponding to an acceleration of the smart playable device and barometer data corresponding to a height of the smart playable device;

determining a speed of the smart playable device based at least in part on the first accelerometer data and the second accelerometer data; and

determining a height of the smart playable device based at least in part on the barometer data;

wherein the second notification includes a first indication of the speed of the smart playable device a second indication of the height of the smart playable device.

16. A system comprising:

one or more processors; and

memory to store computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising;

establishing a wireless connection between a smart playable device and a computing device;

presenting a menu with a plurality of selectable items on a display of the computing device;

receiving first sensor data from the smart playable device;

determining that the first sensor data corresponds to a gesture associated with an action;

determining that the action corresponds to a selection of a gaming application of a plurality of gaming applications;

providing a first notification associated with gameplay instructions associated with the gaming application;

receiving second sensor data from the smart playable device;

determining that the second sensor data corresponds to a motion of the smart playable device;

determining that the motion of the smart playable device is in accordance with at least one gaming rule associated with the gaming application; and

providing a second notification via the computing device based at least in part on the motion of the smart playable device in accordance with the at least one gaming rule.

17. The system as recited in claim 16, wherein the menu is a first menu and the plurality of selectable items is a first plurality of selectable items, the acts further comprising:

determining that the first sensor data includes first accelerometer data indicating a tap gesture;

mapping the tap gesture to the selection of the gaming application;

presenting a second menu with one or more second plurality of selectable items on the display of the computing device;

receiving third sensor data from the smart playable device;

determining that the third sensor data includes second accelerometer data indicating a spin gesture;

mapping the spin gesture to a navigation from a first item of the second plurality of selectable items to a second item of the second plurality of selectable items; and

animating on the display of the computing device the navigation within the second menu.

18. The system as recited in claim 16, the acts further comprising:

receiving third sensor data from the smart playable device;

determining that the third sensor data corresponds to a first spin gesture based on a first direction of rotation of the smart playable device occurring within a first time threshold;

receiving fourth sensor data from the smart playable device; and

determining that the fourth sensor data corresponds to a second spin gesture based on the first direction of rotation of the smart playable device and a second direction of spin of the smart playable device occurring within a second time threshold.

19. The system as recited in claim 16, the acts further comprising:

determining an identity of a user associated with the smart playable device;

determining a user profile associated with the user; and

interpreting sensor data from the smart playable device as one or more gestures based at least in part on one or more gesture preferences associated with the user profile.

20. The system as recited in claim 16, the acts further comprising:

determining that the second sensor data includes at least first accelerometer data and second accelerometer data corresponding to an acceleration of the smart playable device and barometer data corresponding to a height of the smart playable device;

determining a speed of the smart playable device based at least in part on the first accelerometer data and the second accelerometer data; and

determining a height of the smart playable device based at least in part on the barometer data;

wherein the second notification includes a first indication of the speed of the smart playable device a second indication of the height of the smart playable device.