ORIENTING A USER INTERFACE OF A CONTROLLER FOR OPERATING A SELF-PROPELLED DEVICE

• US 20160202696A1
• Filed: 02/10/2016
• Published: 07/14/2016
• Est. Priority Date: 01/05/2011
• Status: Active Grant

• Current Assignee: Sphero Inc.
• Original Assignee: Sphero Inc.
• Inventors: Bernstein, Ian H., Wilson, Adam, Smith, Brian Keith
• Granted Patent: US 9,841,758 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: A63H 33/005 Motorised rolling toys
• CPC Class Codes: B62D 61/00 Motor vehicles or trailers, characterised by the arrangement or number of wheels, not otherwise provided for, e.g. four wheels in diamond pattern
• CPC Class Codes: G05D 1/0011 associated with a remote control arrangement
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0044 by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps maps used for automatic navigation G05D1/0274; flight directors G01C23/005
• CPC Class Codes: G05D 1/0088 characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours using knowledge based models G06N5/00
• CPC Class Codes: G05D 1/0212 with means for defining a desired trajectory involving a plurality of land vehicles G05D1/0287
• CPC Class Codes: G05D 1/0259 using magnetic or electromagnetic means
• CPC Class Codes: G05D 1/027 comprising intertial navigation means, e.g. azimuth detector inertial navigation G01C21/16; inertial navigation combined with non-inertial navigation instruments G01C21/165
• CPC Class Codes: G05D 1/0278 using satellite positioning signals, e.g. GPS
• CPC Class Codes: G05D 1/0891 specially adapted for land vehicles
• CPC Class Codes: Y10S 901/01 Mobile robot

Abstract

A self-propelled device determines an orientation for its movement based on a pre-determined reference frame. A controller device is operable by a user to control the self-propelled device. The controller device includes a user interface for controlling at least a direction of movement of the self-propelled device. The self-propelled device is configured to signal the controller device information that indicates the orientation of the self-propelled device. The controller device is configured to orient the user interface, based on the information signaled from the self-propelled device, to reflect the orientation of the self-propelled device.

Claims

1. (canceled)

2. A controller device for operating a self-propelled device, the controller device comprising:

a touch-sensitive display;

one or more processors; and

one or more memory resources storing instructions that, when executed by the one or more processors, cause the one or more processors to;

generate a virtual steering mechanism on the touch-sensitive display to enable a user to remotely operate the self-propelled device;

receive orientation information from the self-propelled device, the orientation information indicating an orientation of the self-propelled device in relation to an initial frame of reference; and

directionally calibrate the virtual steering mechanism according to the orientation information from the self-propelled device.

3. The controller device of claim 2, wherein the orientation information originates from an inertial measurement unit included within the self-propelled device.

4. The controller device of claim 2, wherein directionally calibrating the virtual steering mechanism comprises calibrating a forward operating direction of the virtual steering mechanism to align with a forward operating direction of the self-propelled device.

5. The controller device of claim 2, wherein the instructions, when executed by the one or more processors, further cause the controller device to:

receive one or more user interactions with the virtual steering mechanism, the one or more user interactions to maneuver the self-propelled device; and

transmit one or more commands to the self-propelled device, the one or more commands to maneuver the self-propelled device in accordance with the one or more user interactions.

6. The controller device of claim 5, wherein the instructions, when executed by the one or more processors, further cause the controller device to:

in response to transmitting the one or more commands, generating an animation on the touch-sensitive display, the animation reflecting the maneuvering of the self-propelled device.

7. The controller device of claim 2, wherein the executed instructions cause the one or more processors to receive the orientation information from the self-propelled device in response to establishing a wireless connection with the self-propelled device.

8. The controller device of claim 2, wherein the executed instructions cause the one or more processors to periodically receive the orientation information to periodically recalibrate the virtual steering mechanism with the self-propelled device.

9. A computer-implemented method for operating a self-propelled device, the method performed by one or more processors of a controller device and comprising:

generating a virtual steering mechanism on a touch-sensitive display of the controller device, the virtual steering mechanism enabling a user to remotely operate the self-propelled device;

receiving orientation information from the self-propelled device, the orientation information indicating an orientation of the self-propelled device in relation to an initial frame of reference; and

directionally calibrating the virtual steering mechanism according to the orientation information from the self-propelled device.

10. The method of claim 9, wherein the orientation information originates from an inertial measurement unit included within the self-propelled device.

11. The method of claim 9, wherein directionally calibrating the virtual steering mechanism comprises calibrating a forward operating direction of the virtual steering mechanism to align with a forward operating direction of the self-propelled device.

12. The method of claim 9, further comprising:

receiving one or more user interactions with the virtual steering mechanism, the one or more user interactions to maneuver the self-propelled device; and

transmitting one or more commands to the self-propelled device, the one or more commands to maneuver the self-propelled device in accordance with the one or more user interactions.

13. The method of claim 12, further comprising:

in response to transmitting the one or more commands, generating an animation on the touch-sensitive display, the animation reflecting the maneuvering of the self-propelled device.

14. The method of claim 9, wherein the one or more processors receive the orientation information from the self-propelled device in response to establishing a wireless connection with the self-propelled device.

15. The method of claim 9, wherein the one or more processors periodically receive the orientation information to periodically recalibrate the virtual steering mechanism with the self-propelled device.

16. A non-transitory computer readable medium storing instructions for operating a self-propelled devices, wherein the instructions, when executed by one or more processors of a controller device, cause the controller device to:

generate a virtual steering mechanism on a touch-sensitive display of the controller device, the virtual steering mechanism enabling a user to remotely operate the self-propelled device;

receive orientation information from the self-propelled device, the orientation information indicating an orientation of the self-propelled device in relation to an initial frame of reference; and

directionally calibrate the virtual steering mechanism according to the orientation information from the self-propelled device.

17. The non-transitory computer readable medium of claim 16, wherein the orientation information originates from an inertial measurement unit included within the self-propelled device.

18. The non-transitory computer readable medium of claim 16, wherein directionally calibrating the virtual steering mechanism comprises calibrating a forward operating direction of the virtual steering mechanism to align with a forward operating direction of the self-propelled device.

19. The non-transitory computer readable medium of claim 18, wherein the instructions, when executed by the one or more processors, further cause the controller device to:

receive one or more user interactions with the virtual steering mechanism, the one or more user interactions to maneuver the self-propelled device; and

transmit one or more commands to the self-propelled device, the one or more commands to maneuver the self-propelled device in accordance with the one or more user interactions.

20. The non-transitory computer readable medium of claim 19, wherein the instructions, when executed by the one or more processors, further cause the controller device to:

in response to transmitting the one or more commands, generating an animation on the touch-sensitive display, the animation reflecting the maneuvering of the self-propelled device.

21. The non-transitory computer readable medium of claim 16, wherein the executed instructions cause the one or more processors to receive the orientation information from the self-propelled device in response to establishing a wireless connection with the self-propelled device.